luncherooB to LocalLLaMA@poweruser.forumEnglish · 1 year agoOh We Were So Close, Little 7b Buddyimagemessage-square8fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageOh We Were So Close, Little 7b BuddyluncherooB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square8fedilink
minus-squareBrainSlugs83BlinkfedilinkEnglisharrow-up1·1 year agoHow does the q8_0 version of that model do?
minus-squareluncherooOPBlinkfedilinkEnglisharrow-up1·1 year agoI’m sorry to not be able to report this. I usually aim for the Q5_K_M models due to current hardware limitations with my system.
How does the q8_0 version of that model do?
I’m sorry to not be able to report this. I usually aim for the Q5_K_M models due to current hardware limitations with my system.