Radiant-Practice-270B to LocalLLaMA@poweruser.forumEnglish · 11 months agoWhy is a single a100 so slow?plus-squaremessage-squaremessage-square9fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareWhy is a single a100 so slow?plus-squareRadiant-Practice-270B to LocalLLaMA@poweruser.forumEnglish · 11 months agomessage-square9fedilink
minus-squareRadiant-Practice-270OPBtoLocalLLaMA@poweruser.forum•How can I improve inference performance to a normal range?linkfedilinkEnglisharrow-up1·11 months agosry for late reply. i already test about that , it is better than codellama 13b model but , 30token/s … linkfedilink
Radiant-Practice-270B to LocalLLaMA@poweruser.forumEnglish · 1 year agoHow can I improve inference performance to a normal range?plus-squaremessage-squaremessage-square2fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareHow can I improve inference performance to a normal range?plus-squareRadiant-Practice-270B to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square2fedilink
sry for late reply. i already test about that , it is better than codellama 13b model but , 30token/s …