luncherooB to LocalLLaMA@poweruser.forumEnglish · 2 years agoOh We Were So Close, Little 7b Buddyimagemessage-square8linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageOh We Were So Close, Little 7b BuddyluncherooB to LocalLLaMA@poweruser.forumEnglish · 2 years agomessage-square8linkfedilink
minus-squareBrainSlugs83BlinkfedilinkEnglisharrow-up1·2 years agoHow does the q8_0 version of that model do?
minus-squareluncherooOPBlinkfedilinkEnglisharrow-up1·2 years agoI’m sorry to not be able to report this. I usually aim for the Q5_K_M models due to current hardware limitations with my system.
How does the q8_0 version of that model do?
I’m sorry to not be able to report this. I usually aim for the Q5_K_M models due to current hardware limitations with my system.