Remove Computational Linguistics Remove Continuous Learning Remove Metadata Remove NLP
article thumbnail

Modular Deep Learning

Sebastian Ruder

This post gives a brief overview of modularity in deep learning. For modular fine-tuning for NLP, check out our EMNLP 2022 tutorial. Fuelled by scaling laws, state-of-the-art models in machine learning have been growing larger and larger. Continual learning.  During These models are monoliths. (c)