In no particular order! Don’t forget to use each of their specific prompts for the best generations!
AWQ, and GGUF also available.
https://huggingface.co/NurtureAI/zephyr-7b-beta-16k
https://huggingface.co/NurtureAI/neural-chat-7b-v3-16k
https://huggingface.co/NurtureAI/neural-chat-7b-v3-1-16k
https://huggingface.co/NurtureAI/SynthIA-7B-v2.0-16k
Have fun LocalLLaMA fam <3 ! Let us know what you find! <3
But “true” 16K-32K models like MistralLite seem to perform much better at long context than the default Mistral config.