Senior SWE-Bench: open-source benchmark that assesses agents as senior engineers

An open-source platform for evaluating software development skills, SWE-Bench, is being enhanced to better assess senior engineers by providing more realistic and under-specified task instructions, and introducing a validation agent to evaluate submitted solutions.