mcmoose1900B to LocalLLaMA@poweruser.forumEnglish · 1 year agoNouse-Capybara-34B 200Khuggingface.coexternal-linkmessage-square16fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkNouse-Capybara-34B 200Khuggingface.comcmoose1900B to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square16fedilink
minus-squaremcmoose1900OPBlinkfedilinkEnglisharrow-up1·1 year agoPrecisely 47K fits in 24GB at 4bpw. I have not tried 3.5, but I think it could be much more.
200K context!!
Precisely 47K fits in 24GB at 4bpw.
I have not tried 3.5, but I think it could be much more.