From our experience, to get a very good results you need
High quality dataset. It’s worth to spend more time on data cleaning. It’s way better to have a smaller dataset with high quality points than a huge dataset with garbage.
You need to fully finetune it.
We only do full fine-tune.
We support only large models (starting from 7B).
Hey there. Good catch, haven’t realized a newer version is available. Will update soon!