Porting nanochat to a TPU: what carries over from PyTorch, and what breaks

This article discusses the process of porting the nanochat project to a TPU (Tensor Processing Unit) with JAX (a Python library for high-level numerical computing) and the challenges faced during the process.