Is One Layer Enough? A Single Transformer Layer Matches Full-Parameter RL Train

Researchers investigate how reinforcement learning (RL) adaptation is distributed across transformer layers, finding that training a single layer can recover most of the gains achieved by full-parameter RL training.