Hi guys, Welcome to the Advanced Video Search Engine, and you are watching What is LoRA? Low-Rank Adaptation for finetuning LLMs EXPLAINED. That video is uploaded by AI Coffee Break with Letitia at 2023-09-18T06:00:12-07:00. We are promoting this video only for entertainment and educational purpose only. So, I hope you like & enjoy it. [KEv-F5UkhxU]
| Name | What is LoRA? Low-Rank Adaptation for finetuning LLMs EXPLAINED |
| Video Uploader | Video From AI Coffee Break with Letitia |
| Upload Date | This Video Uploaded At 18-09-2023 13:00:12 |
| Video Discription | How does LoRA work? Low-Rank Adaptation for Parameter-Efficient LLM Finetuning explained. Works for any other neural network as well, not just for LLMs. ➡️ AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring.com/ 📜 „Lora: Low-rank adaptation of large language models“ Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L. and Chen, W., 2021. https://arxiv.org/abs/2106.09685 📚 https://sebastianraschka.com/blog/2023/llm-finetuning-lora.html 📽️ LoRA implementation: https://youtu.be/iYr1xZn26R8 Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 Dres. Trost GbR, Siltax, Vignesh Valliappan, Mutual Information, Kshitij Outline: 00:00 LoRA explained 00:59 Why finetuning LLMs is costly 01:44 How LoRA works 03:45 Low-rank adaptation 06:14 LoRA vs other approaches ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔗 Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research Music 🎵 : Meadows - Ramzoid Video editing: Nils Trost KEv-F5UkhxU |
| Category | Science & Technology |
| Tags | LoRA explained | Low-Rank Adaptation explained | what is LoRA | what is Low-Rank Adaptation | how to tune large language models | finetuning LLMs | Adapter layers explained | what is prefix tuning | what are adapter layers | neural network | AI | visualized | explained | basics | algorithm | example | machine learning research | aicoffeebean | animated | illustrated | letitia parcalabescu | illustrated LoRA | annotated LoRA | low rank LoRA | parameter-efficient training | PEFT | parameter-efficient fine-tuning |
