I tried to apply a lot of prompting techniques in 7b and 13b models. And no matter how hard I tried, there was barely any improvement.

  • No-Belt7582BEnglish
    1·
    10 months ago

    Most of the times issue is with prompt template, especially with the spaces ###instruction vs ### instruction etc.

    Smaller models need good prompt, I tried with newer version of mistral 2.5 7B prompts work superbly on that.