Hyddro26B to LocalLLaMA@poweruser.forumEnglish · 2 years agoWhat is considered the best uncensored LLM right now?message-squaremessage-square38linkfedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareWhat is considered the best uncensored LLM right now?Hyddro26B to LocalLLaMA@poweruser.forumEnglish · 2 years agomessage-square38linkfedilinkfile-text
minus-squareHerr_DrosselmeyerBlinkfedilinkEnglisharrow-up1·2 years agoWhat are you looking for? With a 3090, you can run any 13b model in 8 bit, group size 128, act order true, at decent speed. Go-tos for the more spicy stuff would be Mythomax and Tie fighter.
What are you looking for?
With a 3090, you can run any 13b model in 8 bit, group size 128, act order true, at decent speed.
Go-tos for the more spicy stuff would be Mythomax and Tie fighter.