Hyddro26B to LocalLLaMA@poweruser.forumEnglish · 10 months agoWhat is considered the best uncensored LLM right now?message-squaremessage-square38fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareWhat is considered the best uncensored LLM right now?Hyddro26B to LocalLLaMA@poweruser.forumEnglish · 10 months agomessage-square38fedilinkfile-text
minus-squareHerr_DrosselmeyerBlinkfedilinkEnglisharrow-up1·10 months agoWhat are you looking for? With a 3090, you can run any 13b model in 8 bit, group size 128, act order true, at decent speed. Go-tos for the more spicy stuff would be Mythomax and Tie fighter.
What are you looking for?
With a 3090, you can run any 13b model in 8 bit, group size 128, act order true, at decent speed.
Go-tos for the more spicy stuff would be Mythomax and Tie fighter.