MSRA Day for SICSS
On July 5th, 2024, Microsoft Research Asia (MSRA) hosted the MSRA Day as part of the Summer Institute in Computational Social Science (SICSS). This event, held at MSRA’s headquarters, featured a series of impactful presentations…
MInference: Million-Tokens Prompt Inference for Long-context LLMs
Million-Tokens Prompt Inference for Long-context LLMs MInference 1.0 leverages the dynamic sparse nature of LLMs’ attention, which exhibits some static patterns, to speed up the pre-filling for long-context LLMs. It first determines offline which sparse pattern…
Tools for Thought
Better thinking through AIA People-Centric AI Project “What would you rather have: a tool that thinks for you, or a tool that makes you think?” Senior Researcher Advait Sarkar presented at TEDAI (opens in new…
GraphRAG: New tool for complex data discovery now on GitHub
GraphRAG, a graph-based approach to retrieval-augmented generation (RAG) that significantly improves question-answering over private or previously unseen datasets, is now available on GitHub.