Set aside benchmarks, if you had to choose one to use instead of ChatGPT for the next 6 months, which one would you pick? Recently, I’ve been experiencing some extreme slow down and poor answers on GPT so I’m going to run a local backup for the time being to assist when GPT4 is down. I’m leaning towards Mistral. I can be convinced to test some others, though.
I run orca-mini 3b on my old Ubuntu powered laptop and it’s surprisingly good at making simple and readable python scripts. It only has a fraction of the knowledge of Wikipedia but I can just use Wikipedia if needed.