I’m confused by all these prefixes that appear in the finetunes of base models. Is there a glossary of all these words and similar ones?

  • swagonflyyyyB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Hermes is the messenger of the gods. It is a metaphor. I’m sure the rest of them have their own meaning as well.

  • vicks9880B
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    These are just names, LLaMA originally meant ( Large language model Meta AI), but it appears that its also the name of South American animal, thus creative people of internet who download those weights, fine-tuned it and published it with the other animals of same family like alpaca, vicuna, dalai (llama) etc.

    There are more important information in these model names, which are suffix, like parameter counts13B, quantization methods GGUF/GGML, fine-tuning techniques like LoRA, fine-tuning parameters like Q6_K_M etc are used.