Just wondering what are peoples go to LLM’s when they really want to get creative/unique stories. What I am mainly looking for is creative sparks of brilliance that really feel like it’s something fresh/unique/creative with writing that just flows well.
Mine are as follows (using KoboldCPP):
1.) psymedrp-v1-20b.Q5_K_M Settings: Quick Preset: Mayday, Temp 1.2, Top P Sampling 0.99
link: https://huggingface.co/TheBloke/PsyMedRP-v1-20B-GGUF
Notes: This one really gets creative and has lines that make me smile for how outlandish, bizzare and creative they sometimes are. Sometimes goes a little off the deep end but generally this is one is a powerhouse of creativity.
2.) dolphin-2.1-mistral-7b.Q8_0 Settings: Quick Preset: Mayday, Temp 1.2, Top P Sampling 0.95
link: https://huggingface.co/TheBloke/dolphin-2.1-mistral-7B-GGUF
Notes: Love this little creative maestro. Very eloquent and the wordplay is fun and fresh with occasionally very poetic/flowery prose (sometimes a tad too much). Overall very solid.
3.) collectivecognition-v1.1-mistral-7b.Q8_0 Settings: Quick Preset: Mayday, Temp 1.3, Top P Sampling 0.95
link: https://huggingface.co/TheBloke/CollectiveCognition-v1.1-Mistral-7B-GGUF
Notes: Also just as creative as dolphin.2.1 with possibly a more serious tone. Also on occasion uses very techy words like ’ algebra ', ‘algorithmic’ when describing mundane things but overall a solid creative 7b.
So what are your guys faves? (with settings too please).
Athena V4
Think it’s aimed at ERP but remarkably pleasant at general upbeat female AI persona.
dolphin.2.1 with possibly a more serious tone.
Tried the yi dolphin one a bit…seems to provide much shorter & curt responses. Def doesn’t feel story telling like to me. Maybe the mistral version is better
Agreed, I tried Yi-Dolphin too, it just didn’t have the same charisma as dolphin 2.1 in my opinion.
Tess and Capybara 34B are both excellent, I’m just running them merged. There’s really nothing else with such long context, and that is so smart at handling the long context.
Nice, thanks. Is this the one you are referring to?:
https://huggingface.co/TheBloke/Capybara-Tess-Yi-34B-200K-GGUF
Yeah. I am running the exl2 quant though, it lets you fit a ton of context.
Tess 1.1 by itself is also said to be good: https://huggingface.co/models?sort=modified&search=tess+1.1