G. Ramalingam

关于

My interests include: Programming languages, Programming tools, Static program analysis, Formal methods, Software verification, Concurrency, Distributed programming, DNN Model Inference.

From 2017 onwards, I have been working in the area of model inference (for DNNs and ML) via ONNX (opens in new tab), onnxruntime (opens in new tab), onnxscript (opens in new tab), onnx-ir (opens in new tab), Mobius (opens in new tab), the PyTorch ONNX Exporter, and related topics. I was a founding team member of ONNX, which is an open standard for describing (trained) neural network models and classical ML models. It contains a domain-specific programming language for tensor computations at its heart. I was also a founding team member for onnxruntime, which is a cross-platform runtime for ONNX that runs on diverse hardware.

Onnxscript is a python-based DSL for creating ONNX models built on top of onnx-ir, which is a python-based in-memory representation of ONNX suitable for analyses, optimizations, and transformations of ONNX models. Onnxscript also includes a rewriter that supports declarative conditional rewrite-rules for ONNX, making it easy to express fusion-optimizations that replace a complex subgraph of ONNX operations by another subgraph.

Mobius provides model definitions for generative AI architectures — LLMs, MoE, multimodal, encoder-only, encoder-decoder, vision, audio, and diffusion models — built directly in ONNX format.

During 2020-2021, I worked on the initial software stack, for model inference on the first version of Microsoft’s AI Accelerator (MAIA (opens in new tab)).

From 2006 to 2020, I was a member of the Programming Languages and Tools Group at Microsoft Research India.

From 1993 to 2006 July, I was with the IBM T.J.Watson Research Center (opens in new tab).

From 1987 to 1993, I was a graduate student at the Computer Sciences Department (opens in new tab) of the University of Wisconsin – Madison (opens in new tab) , where I completed my Ph.D. under the guidance of Prof. Thomas Reps (opens in new tab).

From 1983 to 1987, I did my undergraduate studies at the CS department at IIT Madras, India.