minus-squareChromix_BtoLocalLLaMA@poweruser.forum•Anyone get Amazon’s long-context MistralLite to work properly?linkfedilinkEnglisharrow-up1·1 year agoYou wrote that it works for short prompts. Did you also try slightly longer prompts (up to 4k tokens)? This doesn’t hit the sliding window yet, but still resulted in not much useful output for me and some others. linkfedilink
Chromix_B to LocalLLaMA@poweruser.forumEnglish · 1 year agoMistralLite not able to summarize text?plus-squaremessage-squaremessage-square1fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareMistralLite not able to summarize text?plus-squareChromix_B to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square1fedilink
You wrote that it works for short prompts. Did you also try slightly longer prompts (up to 4k tokens)? This doesn’t hit the sliding window yet, but still resulted in not much useful output for me and some others.