In no particular order! Don’t forget to use each of their specific prompts for the best generations!
AWQ, and GGUF also available.
https://huggingface.co/NurtureAI/zephyr-7b-beta-16k
https://huggingface.co/NurtureAI/neural-chat-7b-v3-16k
https://huggingface.co/NurtureAI/neural-chat-7b-v3-1-16k
https://huggingface.co/NurtureAI/SynthIA-7B-v2.0-16k
Have fun LocalLLaMA fam <3 ! Let us know what you find! <3
is this a scam or what? none of the models above are from NurtureAI:
- zephyr-beta is trained by HuggingFace and is 32K by default
- neural-chat is from Intel
- synthia is from migtissera
Original links:
https://huggingface.co/HuggingFaceH4/zephyr-7b-beta
these are the 16k context versions lol its no scam, they give them credit in the model cards.
Its real easy to test the 16k, and the regular ones with long RAG like prompts to see which is better, as far as staying on task, and not hallucinating… Its important to understand, terms are terms, architectures are architectures, dont dwell too much on the words. Instead focus on your output. I am not saying use these models, I am saying don’t lose the very thing which makes a scientist effective, the ability to do an experiment. The fact that so many people went to it should tell u something too, just a thought. I am not here to convince you, just share what I found.
Sharing is caring.
I also released chupacabra 7b awq version to get extra crispy.