Hey there! Thanks for the tip. I have made some research and found out this : https://github.com/ymcui/Chinese-LLaMA-Alpaca

So for those who are interested here is what I understand from what needs to be done :

1. If Llama2 tokenizer does not support your language, you need to expand that vocabulary first
2. You’ll need data for further fine tuning, and also for instruction tuning.
3. And you will need money :D For training