The point is Meta till now always also released base models.
That would require them to release only fine-tuned model like llama2-chat was. Then they can bork it which would be irreversible. But if they give out base model without some stuff - it can be easily added.
Ooooh, I really want to see the marvelous “mechanism” to prevent open source model from misuse.
*Provided you use the non fine tuned model straight from Meta’s download page so that they’re safe.
They can ingrain those refusals pretty deep to where it will be irritating to use and hard to fine tune out. Vicuna has a bit of this.
The point is Meta till now always also released base models.
That would require them to release only fine-tuned model like llama2-chat was. Then they can bork it which would be irreversible. But if they give out base model without some stuff - it can be easily added.