Unified Database: Laying the foundation for large language model vertical applications
Unified databases offer better knowledge transfer between multimodal data types. They provide substantial corpus support for large language models and are poised to drive innovation in underlying hardware, laying the foundation for data-enhanced AI.
Empowering NGOs with generative AI in the fight against human trafficking
Intelligence Toolkit was built to help fight human trafficking and is applicable to a broad range of societal challenges. Learn how Microsoft researchers worked with global experts to develop generative AI tools that could help…
MSRA Day for SICSS
On July 5th, 2024, Microsoft Research Asia (MSRA) hosted the MSRA Day as part of the Summer Institute in Computational Social Science (SICSS). This event, held at MSRA’s headquarters, featured a series of impactful presentations…
MInference: Million-Tokens Prompt Inference for Long-context LLMs
Million-Tokens Prompt Inference for Long-context LLMs MInference 1.0 leverages the dynamic sparse nature of LLMs’ attention, which exhibits some static patterns, to speed up the pre-filling for long-context LLMs. It first determines offline which sparse pattern…