Reading MAI's efficiency gain. How to pick architectures like serious people

The article discusses the concept of efficiency gain (EG) in machine learning, which measures the trade-off between compute budget and final loss in model design. It introduces a method to compute EG using a baseline ladder and a power law curve fit, allowing for the comparison of different model designs on various cost axes.