What is currently the leading chatbot that can be self hosted on your computer?

I have heard about alot of them and it seems like everyone and there dog is making one however I’m not sure which one I should be use.

​

Edit : I am running a 3060 with 12GB of ram

  • randomsnark@lemmy.mlEnglish
    1·
    1 year ago

    I haven’t tried running any myself so my knowledge is just from having glanced at a few discussions in AI communities when it’s come up, but I think Mistral 7B might be the current best, or a fine-tune of it such as Mistral 7B OpenOrca or Mistral 7B OpenHermes.

  • centomilaBEnglish
    1·
    1 year ago

    I recommend LMSTUDIO (https://lmstudio.ai/).

    It allows you to manage and download models from Hugging Face, and suggests models compatible with your machine. Additionally, it can initiate a local HTTP server that functions similarly to OpenAI’s API."

  • SuperLucas2000BEnglish
    1·
    1 year ago

    Can someone explain what is the benefit of running all of these models locally? Are they better than the free available chatgpt? Any good reading on how to learn/get started with all this?