Modular Deep Learning

Modular Deep Learning

This post gives a brief overview of modularity in deep learning. For a more in-depth review, refe...概要を表示 This post gives a brief overview of modularity in deep learning. For a more in-depth review, refer to our survey. For modular fine-tuning for NLP, check out our EMNLP 2022 tutorial. For more resources, check out modulardeeplearning.com. Fuelled by scaling laws, state-of-the-art models in machine learning have been growing larger and larger. These models are monoliths. They are pre-trained from scr

• AI
• あとで読む