What is the best way to learn LLM / generative AI topics in depth:

  • loss functions
  • finetuning (LoRA, QLoRA, etc)
  • creating good datasets
  • quantization, AWQ

etc. I know there is the Fast AI course, but more interested in these above topics. Seems like there are scattered guides, notebooks and a promising repo here: https://github.com/peremartra/Large-Language-Model-Notebooks-Course but nothing comprehensive.

  • BlueMetaMindB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Absolutely! I wanted to start a thread like this myself. There is information out there for general AI stuff. But I seek concrete tutorials and articles about current open source LLMs practice . I agree that knowledge is frustratingly scattered.