Can a MUD evaluate LLMs? A $99 proof of concept

The author discusses a proof of concept experiment using a MUD (text games) to evaluate LLMs, highlighting the unreliability of LLM judges and the need for a more robust Phase 2.