Hi community,
i am writing my own GUI in wich i want to use a LLM completely local. The problem is i dont know how to start with the LLM.
Can someone explain to me how the first steps work to integrate/work with the LLM or does someone know some good tutorials?
The LLM is downloaded localy. Now i need to integrate a library or something? sry i could not find a lot useful/direct information about the topic.
Thank you very much in advance!
Thanks for the comments so far!
My intention was to learn about LLM and to put that into practice. I am aware of already existing projekts and have something working already. It just feels a bit overloaded or impractical.
There aren’t many tutorials and there is already a fully local llm gui oobabooga
Don’t start writing entire GUI. First make a simple code that loads model and does interference. There are probably 10 lines in total. You can just grab the code people have with their models (like TheBloke always post a code snippet)
Now create gui and instead of preset text add text box and a button “Go” so it can do interfernce from your text.
Boom, A GUI.
Now go from there, keep adding - dropdown list to select model, dropdown list to select instruction template…etc…