Hi guys, Welcome to the Advanced Video Search Engine, and you are watching Data-efficient Image Transformers EXPLAINED! Facebook AI's DeiT paper. That video is uploaded by AI Coffee Break with Letitia at 2021-01-02T03:00:00-08:00. We are promoting this video only for entertainment and educational purpose only. So, I hope you like & enjoy it. [-FbV2KgRM8A]
| Name | Data-efficient Image Transformers EXPLAINED! Facebook AI's DeiT paper |
| Video Uploader | Video From AI Coffee Break with Letitia |
| Upload Date | This Video Uploaded At 02-01-2021 11:00:00 |
| Video Discription | "Training data-efficient image transformers & distillation through attention" paper explained! How does the DeiT transformer for image recognition by @facebookai train with around 100x less training data than ViT? ➡️ AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring.com/ ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 📺 ViT Transformer: https://youtu.be/DVoHvmww2lQ 📺 Transformer architecture explained: https://youtu.be/FWFA4DGuzSc 📺 Visual Chirality: https://youtu.be/rbg1Mdo2LZM Outline: * 00:00 Facebook’s DeiT * 01:34 Why is DeiT cool? * 03:03 How does it work? * 07:10 What does this mean? 📄 DeiT paper: https://arxiv.org/pdf/2012.12877.pdf Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, Hervé Jégou (2020) “Training data-efficient image transformers & distillation through attention” 💻 DeiT code: https://github.com/facebookresearch/deit 📚 For an in-depth understanding of how it works, check out this wonderful post by @JacobGildenblat https://jacobgil.github.io/deeplearning/vision-transformer-explainability 📚 On-point blog post by Andrei-Cristian Rad: https://radandreicristian.medium.com/what-to-do-if-training-on-jft-300m-is-not-an-option-convnet-teachers-to-the-rescue-104a7bf7dccb News music 🎵 source: News Theme 2 by Audionautix is licensed under a Creative Commons Attribution 4.0 licence. https://creativecommons.org/licenses/by/4.0/ Artist: http://audionautix.com/ 🔗 Links: YouTube: https://www.youtube.com/AICoffeeBreak Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ #AICoffeeBreak #MsCoffeeBean #DeiT #MachineLearning #AI #research -FbV2KgRM8A |
| Category | Education |
| Tags | DeiT | paper | publication | distillation | attention is all you need | image transformer | visual transformer | ViT | Facebook Research | Google | data-efficient | transformer architecture | CV | computer vision | AI | artificial intelligence | learning | machine learning | deep learning | easy | beginner | explained | basics | comprehensible | research | computer science | women in ai | womeninai | algorithm | example | for beginners | CNN | convolutional neural networks | An image is worth 16x16 words | teacher student | animated |
