RELEVANCE: Automatic Evaluation Framework for LLM Responses
Generative AI (GenAI) evaluation framework designed to automatically evaluate creative responses from Large Language Models (LLMs) RELEVANCE (Relevance and Entropy-based Evaluation with Longitudinal Inversion Metrics) is a generative AI evaluation framework designed to automatically evaluate…
What’s Your Story: Weishung Liu
Principal PM Manager Weishung Liu shares how a career delivering products and customer experiences aligns with her love of people and storytelling and how—despite efforts to defy the expectations that come with growing up in…
The Crossroads of Innovation and Privacy: Private Synthetic Data for Generative AI
Synthetic data could potentially help address some privacy concerns with AI model development and training, but it comes with limitations. Researchers at Microsoft are exploring techniques for producing more realistic data with strong privacy protections.
Research Focus: Week of May 27, 2024
How can generative AI tools represent less common identities and narratives; Can LLMs help players participate in game narratives; Using LLMs to improve geospatial demographic data; A Graph RAG Approach to Query-Focused Summarization; and more.