Gram Newton-Schulz: A Fast, Hardware-Aware Newton-Schulz Algorithm for Muon

This article presents a new algorithm called Gram Newton-Schulz, which is a reworking of the Newton-Schulz routine to reduce the optimizer time by up to 50% in trillion-parameter models. The algorithm is designed to be more efficient and stable than the standard Newton-Schulz method.