seraschkaB to Machine Learning@academy.gardenEnglish · 1 year ago[P] Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation): Things I Learned From Hundreds of Experimentsmagazine.sebastianraschka.comexternal-linkmessage-square2fedilinkarrow-up11arrow-down10cross-posted to: localllama@poweruser.forum
arrow-up11arrow-down1external-link[P] Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation): Things I Learned From Hundreds of Experimentsmagazine.sebastianraschka.comseraschkaB to Machine Learning@academy.gardenEnglish · 1 year agomessage-square2fedilinkcross-posted to: localllama@poweruser.forum
minus-squareseraschkaOPBlinkfedilinkEnglisharrow-up1·1 year ago =256, alpha=64 I think I need glasses 😅. You are right that other ratios worked quite well, too, indeed. I amended this section a bit.
I think I need glasses 😅. You are right that other ratios worked quite well, too, indeed. I amended this section a bit.