I’m using 4.5bpw quant courtesy u/Panchovix for RP.

Every time we speak about loneliness, lost love or something like this, it start t-to… s-speak… *sob* speak like… this.

And I can’t find a way to recover the conversation from this state. The narrations are fine, only character’s speech is affected. It especially prominent when using Mirostat due to lack of repetition control.

So far I tried, with little to no success:

  • instruct it to speak as usual,
  • rewriting it’s reply,
  • temporary switching to sampler strategy with repetition penalty,

Anyone else experiences this, and how else to deal with it?

  • fediverserEnglish
    1·
    10 months ago

    This post is an automated archive from a submission made on /r/LocalLLaMA, powered by Fediverser software running on alien.top. Responses to this submission will not be seen by the original author until they claim ownership of their alien.top account. Please consider reaching out to them let them know about this post and help them migrate to Lemmy.

    Lemmy users: you are still very much encouraged to participate in the discussion. There are still many other subscribers on !localllama@poweruser.forum that can benefit from your contribution and join in the conversation.

    Reddit users: you can also join the fediverse right away by getting by visiting https://portal.alien.top. If you are looking for a Reddit alternative made for and by an independent community, check out Fediverser.