OmniCode: A Benchmark for Evaluating Software Development Agents

Atharv Sonwane, Eng-Shen Tu, Wei-Chung Lu, Claas Beger, Carter Larsen, Debjit Dhar, Simon Alford, Rachel Chen, Ronit Pattanayak, Tuan Anh Dang, Guohao Chen, Gloria Geng, Kevin Ellis, Saikat Dutta 0001. OmniCode: A Benchmark for Evaluating Software Development Agents. In Maria Liakata, Viviane P. Moreira, Jiajun Zhang 0001, David Jurgens, editors, Findings of the Association for Computational Linguistics, ACL 2026, San Diego, California, United States, July 2-7, 2026. pages 40634-40661, Association for Computational Linguistics, 2026. [doi]

Abstract

Abstract is missing.