GAUSS: A Workload-Aware Analytical and Monte-Carlo Simulator for LLM Inference Serving
Srikant Bharadwaj, Ankur Mallick, Spyridon (Spyros) Mastorakis, A. Parayil, Dhruv Deshmukh, Victor Ruehle
October 2026
arXiv | October 2026
Technical Report
Srikant Bharadwaj, Ankur Mallick, Spyridon (Spyros) Mastorakis, A. Parayil, Dhruv Deshmukh, Victor Ruehle
October 2026
arXiv | October 2026
Technical Report
Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
ACM Sigmetrics 2026 | June 2026
May 2026
May 2026
Helia Hashemi, Victor Ruehle, Saravan Rajmohan
2026 The Web Conference | April 2026
Dongge Han, Camille Couturier, Daniel Madrigal, Xuchao Zhang, Victor Ruehle, Saravan Rajmohan
AAMAS 2026 | January 2026
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
Supercomputing | November 2025
Kirill P. Kalinin, Jannes Gladrow, Jiaqi Chu, James H. Clegg, Daniel Cletheroe, Douglas J. Kelly, Babak Rahmani, Grace Brennan, Burcu Canakci, Fabian Falck, Michael Hansen, Jim Kleewein, Heiner Kremer, Greg O’Shea, Lucinda Pickup, Saravan Rajmohan, Ant Rowstron, Victor Ruehle, Lee Braine, Shrirang Khedekar, Natalia G. Berloff, Christos Gkantsidis, Francesca Parmigiani, Hitesh Ballani
Nature | September 2025
Weixuan Wang, Dongge Han, Daniel Madrigal, Jin Xu, Victor Ruehle, Saravan Rajmohan
ArXiv | August 2025
Shivam Shandilya, Menglin Xia, Supriyo GHOSH, Huiqiang Jiang, Jue Zhang, Qianhui Wu, Victor Ruehle, Saravan Rajmohan
ACL 2025 Findings | August 2025
Menglin Xia, Victor Ruehle, Saravan Rajmohan, Reza Shokri
ICML 2025 | July 2025
Dujian Ding, Ankur Mallick, Shaokun Zhang, Chi Wang, Daniel Madrigal, Mirian Hipolito Garcia, Menglin Xia, L. Lakshmanan, Qingyun Wu, Victor Ruehle
ArXiv | June 2025
Dongge Han, Menglin Xia, Daniel Madrigal, Samuel Kessler, Ankur Mallick, Xuchao Zhang, Mirian Hipolito Garcia, Jin Xu, Victor Ruehle, Saravan Rajmohan
ICML TTODLer-FM Workshop 2025 | June 2025
Camille Couturier, Spyridon (Spyros) Mastorakis, Haiying Shen, Saravan Rajmohan, Victor Ruehle
ArXiv | May 2025
Lu Wang, Mayukh Das, Fangkai Yang, Bo Qiao, Hang Dong, Si Qin, Victor Ruehle, Chetan Bansal, Eli Cortez, Íñigo Goiri, Saravan Rajmohan, Qingwei Lin 林庆维, Dongmei Zhang
MLSys’25 | May 2025
Shaokun Zhang, Jieyu Zhang, Dujian Ding, Mirian Hipolito Garcia, Ankur Mallick, Daniel Madrigal, Menglin Xia, Victor Ruehle, Qingyun Wu, Chi Wang
ICLR Workshop on Reasoning and Planning for Large Language Models | April 2025
Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
EuroMLSys 2025 | April 2025
Haoran Qiu, Anish Biswas, Zihan Zhao, Jayashree Mohan, Alind Khare, Esha Choukse, Íñigo Goiri, Zeyu Zhang, Haiying Shen, Chetan Bansal, Ramachandran Ramjee, Rodrigo Fonseca
February 2025
Arxiv | February 2025
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024
Metod Jazbec, Menglin Xia, Ankur Mallick, Daniel Madrigal, Dongge Han, Samuel Kessler, Victor Ruehle
NeurIPS FITML workshop 2024 | December 2024
Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
ArXiv | November 2024
Menglin Xia, Xuchao Zhang, Camille Couturier, Guoqing Zheng, Saravan Rajmohan, Victor Ruehle
EMNLP 2024 Industry Track | November 2024
Shoaib Ahmed Siddiqui, Yanzhi Chen, Juyeon Heo, Menglin Xia, Adrian Weller
COLING 2025 | October 2024
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
May 2024
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang
The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024
Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
ICLR 2024 | February 2024
Chen Dun, Mirian Hipolito Garcia, Guoqing Zheng, Ahmed Awadallah, Anastasios Kyrillidis, Robert Sim
ArXiv | October 2023
Arthi Padmanabhan , Neil Agarwal , Anand Iyer, Ganesh Ananthanarayanan, Yuanchao Shu, Nikolaos Karianakis, Guoqing Harry Xu , Ravi Netravali
USENIX NSDI | April 2023
Fatemehsadat Mireshghallah, Arturs Backurs, Huseyin Inan, Lukas Wutschitz, Janardhan (Jana) Kulkarni
NeurIPS 2022 | November 2022
Srikant Bharadwaj, Ankur Mallick, Spyridon (Spyros) Mastorakis, A. Parayil, Dhruv Deshmukh, Victor Ruehle
October 2026
arXiv | October 2026
Technical Report
Fatemehsadat Mireshghallah, Arturs Backurs, Huseyin Inan, Lukas Wutschitz, Janardhan (Jana) Kulkarni
NeurIPS 2022 | November 2022
Srikant Bharadwaj, Ankur Mallick, Spyridon (Spyros) Mastorakis, A. Parayil, Dhruv Deshmukh, Victor Ruehle
October 2026
arXiv | October 2026
Technical Report
Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
ACM Sigmetrics 2026 | June 2026
May 2026
May 2026
Helia Hashemi, Victor Ruehle, Saravan Rajmohan
2026 The Web Conference | April 2026
Dongge Han, Camille Couturier, Daniel Madrigal, Xuchao Zhang, Victor Ruehle, Saravan Rajmohan
AAMAS 2026 | January 2026
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
Supercomputing | November 2025
Kirill P. Kalinin, Jannes Gladrow, Jiaqi Chu, James H. Clegg, Daniel Cletheroe, Douglas J. Kelly, Babak Rahmani, Grace Brennan, Burcu Canakci, Fabian Falck, Michael Hansen, Jim Kleewein, Heiner Kremer, Greg O’Shea, Lucinda Pickup, Saravan Rajmohan, Ant Rowstron, Victor Ruehle, Lee Braine, Shrirang Khedekar, Natalia G. Berloff, Christos Gkantsidis, Francesca Parmigiani, Hitesh Ballani
Nature | September 2025
Weixuan Wang, Dongge Han, Daniel Madrigal, Jin Xu, Victor Ruehle, Saravan Rajmohan
ArXiv | August 2025
Shivam Shandilya, Menglin Xia, Supriyo GHOSH, Huiqiang Jiang, Jue Zhang, Qianhui Wu, Victor Ruehle, Saravan Rajmohan
ACL 2025 Findings | August 2025
Menglin Xia, Victor Ruehle, Saravan Rajmohan, Reza Shokri
ICML 2025 | July 2025
Dujian Ding, Ankur Mallick, Shaokun Zhang, Chi Wang, Daniel Madrigal, Mirian Hipolito Garcia, Menglin Xia, L. Lakshmanan, Qingyun Wu, Victor Ruehle
ArXiv | June 2025
Dongge Han, Menglin Xia, Daniel Madrigal, Samuel Kessler, Ankur Mallick, Xuchao Zhang, Mirian Hipolito Garcia, Jin Xu, Victor Ruehle, Saravan Rajmohan
ICML TTODLer-FM Workshop 2025 | June 2025
Camille Couturier, Spyridon (Spyros) Mastorakis, Haiying Shen, Saravan Rajmohan, Victor Ruehle
ArXiv | May 2025
Lu Wang, Mayukh Das, Fangkai Yang, Bo Qiao, Hang Dong, Si Qin, Victor Ruehle, Chetan Bansal, Eli Cortez, Íñigo Goiri, Saravan Rajmohan, Qingwei Lin 林庆维, Dongmei Zhang
MLSys’25 | May 2025
Shaokun Zhang, Jieyu Zhang, Dujian Ding, Mirian Hipolito Garcia, Ankur Mallick, Daniel Madrigal, Menglin Xia, Victor Ruehle, Qingyun Wu, Chi Wang
ICLR Workshop on Reasoning and Planning for Large Language Models | April 2025
Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
EuroMLSys 2025 | April 2025
Haoran Qiu, Anish Biswas, Zihan Zhao, Jayashree Mohan, Alind Khare, Esha Choukse, Íñigo Goiri, Zeyu Zhang, Haiying Shen, Chetan Bansal, Ramachandran Ramjee, Rodrigo Fonseca
February 2025
Arxiv | February 2025
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024
Metod Jazbec, Menglin Xia, Ankur Mallick, Daniel Madrigal, Dongge Han, Samuel Kessler, Victor Ruehle
NeurIPS FITML workshop 2024 | December 2024
Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
ArXiv | November 2024
Menglin Xia, Xuchao Zhang, Camille Couturier, Guoqing Zheng, Saravan Rajmohan, Victor Ruehle
EMNLP 2024 Industry Track | November 2024
Shoaib Ahmed Siddiqui, Yanzhi Chen, Juyeon Heo, Menglin Xia, Adrian Weller
COLING 2025 | October 2024
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
May 2024
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang
The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024
Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
ICLR 2024 | February 2024
Chen Dun, Mirian Hipolito Garcia, Guoqing Zheng, Ahmed Awadallah, Anastasios Kyrillidis, Robert Sim
ArXiv | October 2023
Fatemehsadat Mireshghallah, Arturs Backurs, Huseyin Inan, Lukas Wutschitz, Janardhan (Jana) Kulkarni
NeurIPS 2022 | November 2022
Srikant Bharadwaj, Ankur Mallick, Spyridon (Spyros) Mastorakis, A. Parayil, Dhruv Deshmukh, Victor Ruehle
October 2026
arXiv | October 2026
Technical Report
Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
ACM Sigmetrics 2026 | June 2026
Lu Wang, Mayukh Das, Fangkai Yang, Bo Qiao, Hang Dong, Si Qin, Victor Ruehle, Chetan Bansal, Eli Cortez, Íñigo Goiri, Saravan Rajmohan, Qingwei Lin 林庆维, Dongmei Zhang
MLSys’25 | May 2025
Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
ArXiv | November 2024
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
May 2024
Arthi Padmanabhan , Neil Agarwal , Anand Iyer, Ganesh Ananthanarayanan, Yuanchao Shu, Nikolaos Karianakis, Guoqing Harry Xu , Ravi Netravali
USENIX NSDI | April 2023
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang
The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024
Arthi Padmanabhan , Neil Agarwal , Anand Iyer, Ganesh Ananthanarayanan, Yuanchao Shu, Nikolaos Karianakis, Guoqing Harry Xu , Ravi Netravali
USENIX NSDI | April 2023
Srikant Bharadwaj, Ankur Mallick, Spyridon (Spyros) Mastorakis, A. Parayil, Dhruv Deshmukh, Victor Ruehle
October 2026
arXiv | October 2026
Technical Report
May 2026
May 2026
Haoran Qiu, Anish Biswas, Zihan Zhao, Jayashree Mohan, Alind Khare, Esha Choukse, Íñigo Goiri, Zeyu Zhang, Haiying Shen, Chetan Bansal, Ramachandran Ramjee, Rodrigo Fonseca
February 2025
Arxiv | February 2025
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
May 2024
Kirill P. Kalinin, Jannes Gladrow, Jiaqi Chu, James H. Clegg, Daniel Cletheroe, Douglas J. Kelly, Babak Rahmani, Grace Brennan, Burcu Canakci, Fabian Falck, Michael Hansen, Jim Kleewein, Heiner Kremer, Greg O’Shea, Lucinda Pickup, Saravan Rajmohan, Ant Rowstron, Victor Ruehle, Lee Braine, Shrirang Khedekar, Natalia G. Berloff, Christos Gkantsidis, Francesca Parmigiani, Hitesh Ballani
Nature | September 2025
Weixuan Wang, Dongge Han, Daniel Madrigal, Jin Xu, Victor Ruehle, Saravan Rajmohan
ArXiv | August 2025
Dujian Ding, Ankur Mallick, Shaokun Zhang, Chi Wang, Daniel Madrigal, Mirian Hipolito Garcia, Menglin Xia, L. Lakshmanan, Qingyun Wu, Victor Ruehle
ArXiv | June 2025
Camille Couturier, Spyridon (Spyros) Mastorakis, Haiying Shen, Saravan Rajmohan, Victor Ruehle
ArXiv | May 2025
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024
Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
ArXiv | November 2024
Chen Dun, Mirian Hipolito Garcia, Guoqing Zheng, Ahmed Awadallah, Anastasios Kyrillidis, Robert Sim
ArXiv | October 2023
Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
ACM Sigmetrics 2026 | June 2026
Helia Hashemi, Victor Ruehle, Saravan Rajmohan
2026 The Web Conference | April 2026
Dongge Han, Camille Couturier, Daniel Madrigal, Xuchao Zhang, Victor Ruehle, Saravan Rajmohan
AAMAS 2026 | January 2026
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
Supercomputing | November 2025
Shivam Shandilya, Menglin Xia, Supriyo GHOSH, Huiqiang Jiang, Jue Zhang, Qianhui Wu, Victor Ruehle, Saravan Rajmohan
ACL 2025 Findings | August 2025
Menglin Xia, Victor Ruehle, Saravan Rajmohan, Reza Shokri
ICML 2025 | July 2025
Dongge Han, Menglin Xia, Daniel Madrigal, Samuel Kessler, Ankur Mallick, Xuchao Zhang, Mirian Hipolito Garcia, Jin Xu, Victor Ruehle, Saravan Rajmohan
ICML TTODLer-FM Workshop 2025 | June 2025
Lu Wang, Mayukh Das, Fangkai Yang, Bo Qiao, Hang Dong, Si Qin, Victor Ruehle, Chetan Bansal, Eli Cortez, Íñigo Goiri, Saravan Rajmohan, Qingwei Lin 林庆维, Dongmei Zhang
MLSys’25 | May 2025
Shaokun Zhang, Jieyu Zhang, Dujian Ding, Mirian Hipolito Garcia, Ankur Mallick, Daniel Madrigal, Menglin Xia, Victor Ruehle, Qingyun Wu, Chi Wang
ICLR Workshop on Reasoning and Planning for Large Language Models | April 2025
Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
EuroMLSys 2025 | April 2025
Metod Jazbec, Menglin Xia, Ankur Mallick, Daniel Madrigal, Dongge Han, Samuel Kessler, Victor Ruehle
NeurIPS FITML workshop 2024 | December 2024
Menglin Xia, Xuchao Zhang, Camille Couturier, Guoqing Zheng, Saravan Rajmohan, Victor Ruehle
EMNLP 2024 Industry Track | November 2024
Shoaib Ahmed Siddiqui, Yanzhi Chen, Juyeon Heo, Menglin Xia, Adrian Weller
COLING 2025 | October 2024
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang
The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024
Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
ICLR 2024 | February 2024
Arthi Padmanabhan , Neil Agarwal , Anand Iyer, Ganesh Ananthanarayanan, Yuanchao Shu, Nikolaos Karianakis, Guoqing Harry Xu , Ravi Netravali
USENIX NSDI | April 2023
Fatemehsadat Mireshghallah, Arturs Backurs, Huseyin Inan, Lukas Wutschitz, Janardhan (Jana) Kulkarni
NeurIPS 2022 | November 2022