Hi,

I’ve tried to follow a couple step by step guides from August, but the models they’ve used are now apparently outdated, and when I try to load the model into obbaguba, I get a bunch of errors.

So I’ve downloaded the GGUF models from ThatBloke and still having issues with the models only good for “taking instructions” and the server crashes when I try use the chat feature…

Are there any step by step guides that someone can recommend? I want to set up a UI where I can text chat, and also talk to the AI and have the AI reply in voice mode…

System is 7950x3d with 4090 and 64GB DDR5…

I’ve set up Anaconda and python, also got stable diffusion working previously as well… just not Llama2…

Cheers in advance