I’m a data scientist working in consulting (EU) and I would like to push my company to delve more into open-source LLMs over closed ones (OpenAI…).

I’m constantly amazed by the progress shown by open-sourced LLMs in this sub. The increasing efficiency of models coupled with the expanding open-source LLM ecosystem make these models more and more competitive.

I keep thinking that there’s a market for custom LLMs, notably for private-sensitive companies like banks and insurances.

Any insights?

  • AdTall6126BEnglish
    1·
    1 year ago

    Yes there is. Just to mention one of many scenarios:

    Make a chatbot based on a LLM. Learn how to train an LLM from data from the customer. Voila! Your customer just aquired a new employee to handle customer support or internal support.

  • a_beautiful_rhindBEnglish
    1·
    1 year ago

    Aren’t there people selling such services to companies here? Implementing RAG, etc.

  • Temporary-Size7310BEnglish
    1·
    1 year ago

    Absolutely (I’m a datascientist too), I own a fresh company in ML/DL/AI and it works pretty well.

    There is so much room for creation even with current models (RAG pipeline on private data, prototyping locally and train or finetune on instances, real world application mixing others branch like CV, cinematography with SD, implementing liquid NN with LLM and so on)