Hi, I would like to better understand if it is possible to create a chatbot for free trained on a dataset (which I still have to create) on my PC.I was seeing that llama-2 could be a solution but you have to host it.So I understood that an external machine with GPU is needed, but apart from that, is it possible to make a totally private chatbot?I would like to make a small MVP, if so please share with me anything that might be useful .I’m a web dev and I know also python but not the theory below AI

  • silvio194OPB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    But do you think an AI chatbot can run on my PC?

    • tgredditfcB
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 months ago

      You can use oobabooga API to do that. I haven’t done it myself, can’t say much about it.

      • silvio194OPB
        link
        fedilink
        English
        arrow-up
        1
        ·
        10 months ago

        Mmmh okok… But is there a guide from scratch on this?

        • tgredditfcB
          link
          fedilink
          English
          arrow-up
          1
          ·
          10 months ago

          Maybe. I have not done it yet so I don’t know. You can google around.