Human-Like Neural Nets by Catapulting

The article proposes a new approach to creating artificial neural nets with human-like performance by training overparameterized NNs with high-learning-rate/regularization to trigger "catapulting" or "grokking", which leads to true generalization and resolves many outstanding mysteries of artificial versus natural intelligence.