minus-squareAirwolfPLOPBtoLocalLLaMA@poweruser.forum•Help for the n00b? Optimal loader parameters...linkfedilinkEnglisharrow-up1·10 months agoThanks for the informative answer. I will take a look at GGUF models (although I’m not sure yet how to split them between cpu/gpu yet (I will take a look at llama.cpp parameters). linkfedilink
AirwolfPLB to LocalLLaMA@poweruser.forumEnglish · 10 months agoHelp for the n00b? Optimal loader parameters...plus-squaremessage-squaremessage-square3fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareHelp for the n00b? Optimal loader parameters...plus-squareAirwolfPLB to LocalLLaMA@poweruser.forumEnglish · 10 months agomessage-square3fedilink
Thanks for the informative answer. I will take a look at GGUF models (although I’m not sure yet how to split them between cpu/gpu yet (I will take a look at llama.cpp parameters).