minus-squarekitkatmafiaBtoLocalLLaMA@poweruser.forum•What is the best multi-purpose model available right now?linkfedilinkarrow-up1·10 months agoWizard-lm 13b linkfedilink
kitkatmafiaB to LocalLLaMA@poweruser.forumEnglish · 11 months agoIs anyone using vLLM for inference? Are there any faster inference framework for LLama based models?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareIs anyone using vLLM for inference? Are there any faster inference framework for LLama based models?plus-squarekitkatmafiaB to LocalLLaMA@poweruser.forumEnglish · 11 months agomessage-square0fedilink
Wizard-lm 13b