I tried to apply a lot of prompting techniques in 7b and 13b models. And no matter how hard I tried, there was barely any improvement.

  • No-Belt7582B
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Most of the times issue is with prompt template, especially with the spaces ###instruction vs ### instruction etc.

    Smaller models need good prompt, I tried with newer version of mistral 2.5 7B prompts work superbly on that.