(When) Should a Software Factory be Lights-off? Benchmarking Code Review Agents on Bug Detection
Chenyang Yang, Hao He, Ti-Chung Cheng, Jenna Butler, Emerson Murphy-Hill, Carmen Badea, Christian Bird
October 2026
Emerson Murphy-Hill
Principal Researcher
출판물
-
-
-
The Conversation We’re Not Having about AI in Peer Review
Emerson Murphy-Hill, Christian Bird
Onward! Essays | October 2026
-
Where AI Use Is Normalized, Author Seniority but Not AI Disclosure Biases Code Review
Jenna Butler, Emerson Murphy-Hill, Constance Hadley, Alexa Tipton, Nancy Baym, Sankeerti Haniyur, Jina Suh
2026 Visual Languages and Human-Centric Computing | October 2026
VL/HCC 2026 Best Short Paper
-
The Invisible Mentor: Inferring User Actions from Screen Recordings to Recommend Better Workflows
Litao Yan, Andrew Head, K. Milne, Vu Le, Sumit Gulwani, Chris Parnin, Emerson Murphy-Hill
CHI 2026 | September 2026
-
Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents
Aayush Kumar, Avik Dutta, Sumit Gulwani, Gustavo Soares, Advait Sarkar, Emerson Murphy-Hill
IEEE VL/HCC 2026 | July 2026
VLHCC 2026 Best Long Paper Runner-Up
-
“Maybe We Need Some More Examples:” Individual and Team Drivers of Developer GenAI Tool Use
Courtney Miller, Rudrajit Choudhuri, Mara Ulloa, Sankeerti Haniyur, Robert DeLIne, Margaret-Anne Storey, Emerson Murphy-Hill, Christian Bird, Jenna Butler
2026 International Conference on Software Engineering | July 2026
ACM SIGSOFT Distinguished Paper Award
-
-
-
SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks
Sanket Mhatre, Yasharth Bajpai, Sumit Gulwani, Emerson Murphy-Hill, Gustavo Soares
International Conference on AI-powered Software (AIware) | November 2025
AIware Best Benchmark Short Paper
-
Why AI Agents Still Need You: Findings from Developer-Agent Collaborations in the Wild
Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Gustavo Soares, Emerson Murphy-Hill
IEEE/ACM International Conference on Automated Software Engineering, ASE | October 2025
-
TableTalk: Scaffolding Spreadsheet Development with a Language Agent
Jenny T. Liang, Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Vu Le, Chris Parnin, Arjun Radhakrishna, Ashish Tiwari, Emerson Murphy-Hill, Gustavo Soares
ACM Transactions on Computer-Human Interaction | September 2025
-
-
-
(When) Should a Software Factory be Lights-off? Benchmarking Code Review Agents on Bug Detection
Chenyang Yang, Hao He, Ti-Chung Cheng, Jenna Butler, Emerson Murphy-Hill, Carmen Badea, Christian Bird
October 2026
-
Where AI Use Is Normalized, Author Seniority but Not AI Disclosure Biases Code Review
Jenna Butler, Emerson Murphy-Hill, Constance Hadley, Alexa Tipton, Nancy Baym, Sankeerti Haniyur, Jina Suh
2026 Visual Languages and Human-Centric Computing | October 2026
VL/HCC 2026 Best Short Paper
-
“Maybe We Need Some More Examples:” Individual and Team Drivers of Developer GenAI Tool Use
Courtney Miller, Rudrajit Choudhuri, Mara Ulloa, Sankeerti Haniyur, Robert DeLIne, Margaret-Anne Storey, Emerson Murphy-Hill, Christian Bird, Jenna Butler
2026 International Conference on Software Engineering | July 2026
ACM SIGSOFT Distinguished Paper Award
-
SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks
Sanket Mhatre, Yasharth Bajpai, Sumit Gulwani, Emerson Murphy-Hill, Gustavo Soares
International Conference on AI-powered Software (AIware) | November 2025
AIware Best Benchmark Short Paper
-
Why AI Agents Still Need You: Findings from Developer-Agent Collaborations in the Wild
Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Gustavo Soares, Emerson Murphy-Hill
IEEE/ACM International Conference on Automated Software Engineering, ASE | October 2025
-
-
-
The Conversation We’re Not Having about AI in Peer Review
Emerson Murphy-Hill, Christian Bird
Onward! Essays | October 2026
-
The Invisible Mentor: Inferring User Actions from Screen Recordings to Recommend Better Workflows
Litao Yan, Andrew Head, K. Milne, Vu Le, Sumit Gulwani, Chris Parnin, Emerson Murphy-Hill
CHI 2026 | September 2026
-
Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents
Aayush Kumar, Avik Dutta, Sumit Gulwani, Gustavo Soares, Advait Sarkar, Emerson Murphy-Hill
IEEE VL/HCC 2026 | July 2026
VLHCC 2026 Best Long Paper Runner-Up
-
Why AI Agents Still Need You: Findings from Developer-Agent Collaborations in the Wild
Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Gustavo Soares, Emerson Murphy-Hill
IEEE/ACM International Conference on Automated Software Engineering, ASE | October 2025
-
TableTalk: Scaffolding Spreadsheet Development with a Language Agent
Jenny T. Liang, Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Vu Le, Chris Parnin, Arjun Radhakrishna, Ashish Tiwari, Emerson Murphy-Hill, Gustavo Soares
ACM Transactions on Computer-Human Interaction | September 2025
-
-
-
“Maybe We Need Some More Examples:” Individual and Team Drivers of Developer GenAI Tool Use
Courtney Miller, Rudrajit Choudhuri, Mara Ulloa, Sankeerti Haniyur, Robert DeLIne, Margaret-Anne Storey, Emerson Murphy-Hill, Christian Bird, Jenna Butler
2026 International Conference on Software Engineering | July 2026
ACM SIGSOFT Distinguished Paper Award
-
SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks
Sanket Mhatre, Yasharth Bajpai, Sumit Gulwani, Emerson Murphy-Hill, Gustavo Soares
International Conference on AI-powered Software (AIware) | November 2025
AIware Best Benchmark Short Paper
-
Why AI Agents Still Need You: Findings from Developer-Agent Collaborations in the Wild
Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Gustavo Soares, Emerson Murphy-Hill
IEEE/ACM International Conference on Automated Software Engineering, ASE | October 2025
-
TableTalk: Scaffolding Spreadsheet Development with a Language Agent
Jenny T. Liang, Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Vu Le, Chris Parnin, Arjun Radhakrishna, Ashish Tiwari, Emerson Murphy-Hill, Gustavo Soares
ACM Transactions on Computer-Human Interaction | September 2025
-
-
-
TableTalk: Scaffolding Spreadsheet Development with a Language Agent
Jenny T. Liang, Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Vu Le, Chris Parnin, Arjun Radhakrishna, Ashish Tiwari, Emerson Murphy-Hill, Gustavo Soares
ACM Transactions on Computer-Human Interaction | September 2025
-
-
-
(When) Should a Software Factory be Lights-off? Benchmarking Code Review Agents on Bug Detection
Chenyang Yang, Hao He, Ti-Chung Cheng, Jenna Butler, Emerson Murphy-Hill, Carmen Badea, Christian Bird
October 2026
-
-
-
The Conversation We’re Not Having about AI in Peer Review
Emerson Murphy-Hill, Christian Bird
Onward! Essays | October 2026
-
Where AI Use Is Normalized, Author Seniority but Not AI Disclosure Biases Code Review
Jenna Butler, Emerson Murphy-Hill, Constance Hadley, Alexa Tipton, Nancy Baym, Sankeerti Haniyur, Jina Suh
2026 Visual Languages and Human-Centric Computing | October 2026
VL/HCC 2026 Best Short Paper
-
The Invisible Mentor: Inferring User Actions from Screen Recordings to Recommend Better Workflows
Litao Yan, Andrew Head, K. Milne, Vu Le, Sumit Gulwani, Chris Parnin, Emerson Murphy-Hill
CHI 2026 | September 2026
-
Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents
Aayush Kumar, Avik Dutta, Sumit Gulwani, Gustavo Soares, Advait Sarkar, Emerson Murphy-Hill
IEEE VL/HCC 2026 | July 2026
VLHCC 2026 Best Long Paper Runner-Up
-
“Maybe We Need Some More Examples:” Individual and Team Drivers of Developer GenAI Tool Use
Courtney Miller, Rudrajit Choudhuri, Mara Ulloa, Sankeerti Haniyur, Robert DeLIne, Margaret-Anne Storey, Emerson Murphy-Hill, Christian Bird, Jenna Butler
2026 International Conference on Software Engineering | July 2026
ACM SIGSOFT Distinguished Paper Award
-
SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks
Sanket Mhatre, Yasharth Bajpai, Sumit Gulwani, Emerson Murphy-Hill, Gustavo Soares
International Conference on AI-powered Software (AIware) | November 2025
AIware Best Benchmark Short Paper
-
Why AI Agents Still Need You: Findings from Developer-Agent Collaborations in the Wild
Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Gustavo Soares, Emerson Murphy-Hill
IEEE/ACM International Conference on Automated Software Engineering, ASE | October 2025
-
-
-
TableTalk: Scaffolding Spreadsheet Development with a Language Agent
Jenny T. Liang, Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Vu Le, Chris Parnin, Arjun Radhakrishna, Ashish Tiwari, Emerson Murphy-Hill, Gustavo Soares
ACM Transactions on Computer-Human Interaction | September 2025
-