Currently we manually set the temperature and keep it the whole chat. Wouldnt it make more sense to let the model decide a temperature itself depending on the topic?

  • a_beautiful_rhindBEnglish
    1·
    10 months ago

    Automatic temperature does work. It goes great with min_P. I like it more than mirostat and hope everything implements it.