PookaMacPhellimenB to LocalLLaMA@poweruser.forumEnglish · 10 months agoQwen-72B releasedhuggingface.coexternal-linkmessage-square41fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkQwen-72B releasedhuggingface.coPookaMacPhellimenB to LocalLLaMA@poweruser.forumEnglish · 10 months agomessage-square41fedilink
minus-squarea_beautiful_rhindBlinkfedilinkEnglisharrow-up1·10 months agoHeh, 72b with 32k and GQA seems reasonable. Will make for interesting tunes if it’s not super restricted.
Heh, 72b with 32k and GQA seems reasonable. Will make for interesting tunes if it’s not super restricted.