I want to try auto-gen locally. So I wanted to use a good coding LLM to work with it. Any suggestions ?
My system only have 16 gb ram and can only run 7b model with ok speed.
I want to try auto-gen locally. So I wanted to use a good coding LLM to work with it. Any suggestions ?
My system only have 16 gb ram and can only run 7b model with ok speed.
Got it. Thanks. I will try it.