multiverse_fanB to LocalLLaMA@poweruser.forumEnglish · 1 year agoAnyone have a 1B or 3B model that is mostly coherent?message-squaremessage-square16fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareAnyone have a 1B or 3B model that is mostly coherent?multiverse_fanB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square16fedilinkfile-text
I’ve tried a few of these models but it was some months ago. Have y’all seen any that can hold a conversation yet?
minus-square__SlimeQ__BlinkfedilinkEnglisharrow-up1·1 year agoi did this 1.1B TinyLlama quant last week. it’s not smart by any means but it can hold a conversation somewhat. and, crucially, it’s 600mb
i did this 1.1B TinyLlama quant last week. it’s not smart by any means but it can hold a conversation somewhat. and, crucially, it’s 600mb