Munich 1991: The Roots of the Current AI Boom

The article discusses the roots of the current AI boom, tracing back to 1991 when Jürgen Schmidhuber's team at the Technical University Munich laid the foundations for modern deep learning techniques, including Transformers, pre-training, neural network distillation, and deep residual learning.