Publication Generation Probabilities Are Not Enough: Uncertainty Highlighting in AI Code Completions Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan ToCHI | April 2025, Vol 32(1)
Publication ChatBench: From Static Benchmarks to Human-AI Evaluation Serina Chang, Ashton Anderson, Jake Hofman April 2025 Github
Publication Taxonomizing Representational Harms using Speech Act Theory Emily Corvi, Hannah Washington, Stefanie Reed, Chad Atalla, Alex Chouldechova, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Emily Sheng, Dan Vann, Matthew Vogel, Hanna Wallach March 2025 March 2025
Publication Evaluating Compositional Scene Understanding in Multimodal Generative Models Shuhao Fu, A. J. Lee, Anna Wang, Ida Momennejad, Trevor Bihl, Hong-Jing Lu, Taylor Webb Transactions on Machine Learning Research. | March 2025
Publication debug-gym: A Text-Based Environment for Interactive Debugging Xingdi Yuan, Morgane M Moss, Charbel Feghali, Chinmay Singh, Darya Moldavskaya, Drew MacPhee, Lucas Caccia, Matheus Pereira, Minseon Kim, Alessandro Sordoni, Marc-Alexandre Côté March 2025 ArXiv | March 2025 Access
Publication Is a Good Foundation Necessary for Efficient Reinforcement Learning? The Computational Role of the Base Model in Exploration Dylan Foster, Zakaria Mhammedi, Dhruv Rohatgi COLT 2025 | March 2025
Publication AI Automatons: AI Systems Intended to Imitate Humans Alexandra Olteanu, Solon Barocas, Su Lin Blodgett, Lisa Egede, Alicia DeVrio, Myra Cheng March 2025 Video Project
Publication Generative Modeling of Individual Behavior at Scale Nabil Omi, Lucas Caccia, Anurag Sarkar, Jordan Ash, Siddhartha Sen February 2025 arXiv | February 2025
Publication Computational-Statistical Tradeoffs at the Next-Token Prediction Barrier: Autoregressive and Imitation Learning under Misspecification Dhruv Rohatgi, Adam Block, Audrey Huang, Akshay Krishnamurthy, Dylan Foster COLT 2025 | February 2025
Publication Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alex Chouldechova, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs ICML 2025 | January 2025