Andy Konwinski launches $1M Konwinski Prize for contamination-free SWE benchmark
Entrants would be scored on GitHub issues collected only after a submission deadline, closing off the possibility of training on the test set in advance.
Benchmarks & progress · Open weights & ecosystem