oobabooga4B to LocalLLaMA@poweruser.forumEnglish · 1 year agoQuIP#: SOTA 2-bit quantization method, now implemented in text-generation-webui (experimental)github.comexternal-linkmessage-square6fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkQuIP#: SOTA 2-bit quantization method, now implemented in text-generation-webui (experimental)github.comoobabooga4B to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square6fedilink
Omg how can I run it on 3090?