minus-squareChromix_BtoLocalLLaMA@poweruser.forum•Anyone get Amazon’s long-context MistralLite to work properly?linkfedilinkEnglisharrow-up1·3 years agoYou wrote that it works for short prompts. Did you also try slightly longer prompts (up to 4k tokens)? This doesn’t hit the sliding window yet, but still resulted in not much useful output for me and some others. linkfedilink
Chromix_B to LocalLLaMA@poweruser.forumEnglish · 3 years agoMistralLite not able to summarize text?plus-squaremessage-squaremessage-square1linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareMistralLite not able to summarize text?plus-squareChromix_B to LocalLLaMA@poweruser.forumEnglish · 3 years agomessage-square1linkfedilink
You wrote that it works for short prompts. Did you also try slightly longer prompts (up to 4k tokens)? This doesn’t hit the sliding window yet, but still resulted in not much useful output for me and some others.