Base models are not trained for conversations, so you cannot use it as a chat. It’s like GPT-4 and ChatGPT. GPT-4 is the base model, then it’s fine-tuned to be conversational, which is what you see in ChatGPT. Same as Llama vs Chat Llama.
- 1 Post
- 4 Comments
Joined 1 year ago
Cake day: November 12th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
The chat model came out today
Hey there! I think this is doing offloading?
If so, it’s not a new thing. Check out https://huggingface.co/docs/accelerate/usage_guides/big_modeling for a guide with code and videos about it