AaaaaaaaaeeeeeB to LocalLLaMA@poweruser.forum · 10 months ago55B Yi model mergeshuggingface.coexternal-linkmessage-square16fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-link55B Yi model mergeshuggingface.coAaaaaaaaaeeeeeB to LocalLLaMA@poweruser.forum · 10 months agomessage-square16fedilink
minus-squareDesm0ntBlinkfedilinkEnglisharrow-up1·10 months agoHm. I just load gguf yi-34b-chat q4_k_m in oobabooga via llama.cpp with default params and 8k context and it’s just work like a charm. Better (more lively language) than any 70b from openrouter (my local machine can’t handle 70b)
Hm. I just load gguf yi-34b-chat q4_k_m in oobabooga via llama.cpp with default params and 8k context and it’s just work like a charm. Better (more lively language) than any 70b from openrouter (my local machine can’t handle 70b)