LoRA Speedrun – a public wall-clock leaderboard for fine-tuning techniques

This project is a speedrunning competition for LoRA fine-tuning, where participants aim to achieve the highest accuracy on the GSM8K dataset within a single L40S GPU, with the goal of achieving a ≥ 57% exact-match accuracy.