Jugg3rnautB to LocalLLaMA@poweruser.forumEnglish · 3 years agoGPU-over-IP for LLM inference?plus-squaremessage-squaremessage-square1linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareGPU-over-IP for LLM inference?plus-squareJugg3rnautB to LocalLLaMA@poweruser.forumEnglish · 3 years agomessage-square1linkfedilink
Jugg3rnautB to LocalLLaMA@poweruser.forumEnglish · 3 years agoChassis only has space for 1 GPU - Llama 2 70b possible on a budget?plus-squaremessage-squaremessage-square8linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareChassis only has space for 1 GPU - Llama 2 70b possible on a budget?plus-squareJugg3rnautB to LocalLLaMA@poweruser.forumEnglish · 3 years agomessage-square8linkfedilink