TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024
Srikant Bharadwaj
Senior Principal Research Manager
出版物
-
-
-
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
May 2024
-
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
-
-
-
Scalable distributed last-level TLBs using low-latency interconnects
Srikant Bharadwaj, Guilherme Cox, Tushar Krishna, Abhishek Bhattacharjee
International Symposium on Microarchitecture | October 2018
-
-
-
TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024
-
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
May 2024
-
-
-
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
May 2024
-
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
-
Scalable distributed last-level TLBs using low-latency interconnects
Srikant Bharadwaj, Guilherme Cox, Tushar Krishna, Abhishek Bhattacharjee
International Symposium on Microarchitecture | October 2018
-
-
-
-
TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024
-
-
-
-
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
-
Scalable distributed last-level TLBs using low-latency interconnects
Srikant Bharadwaj, Guilherme Cox, Tushar Krishna, Abhishek Bhattacharjee
International Symposium on Microarchitecture | October 2018
-