illustration of zoomed in eye on top of a computer screen on green gradient background

Computer Vision

Enabling computers and devices to understand what they see.

Microsoft at CVPR 2024: Innovations in computer vision and AI research

DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models

Exploring how context, culture, and character matter in avatar research

FeatUp: A Model-Agnostic Framework for Features at Any Resolution

Current selections

Sort by: Most recent

Clear selections

Search within these results

Content Types

People

Stephen Lin (202)

Antonio Criminisi (171)

Rick Szeliski (102)

Baining Guo (83)

Jianfeng Gao (71)

Neel Joshi (66)

Andrew D. Wilson (65)

Jianlong Fu (60)

Cha Zhang (56)

Lijuan Wang (56)

Dong Chen (52)

Dongdong Chen (51)

Caleb Robinson (46)

Cuiling Lan (42)

Harry Shum (41)

Yang Liu (40)

John Snyder (39)

Yan Lu (39)

Linjie Li (34)

Chong Luo (33)

John Winn (33)

Juan M. Lavista Ferres (33)

Andrew Blake (31)

Abigail Sellen (30)

Cecily Morrison (28)

Qi Dai (28)

Nebojsa Jojic (27)

Jiaolong Yang (25)

Dinei Florencio (24)

Furu Wei (23)

Vibhav Vineet (22)

Anthony Ortiz (22)

Xiyang Dai (22)

Rahul Dodhia (21)

Kevin Lin (20)

Ganesh Ananthanarayanan (19)

Tadas Baltrusaitis (19)

Ed Cutrell (18)

Bei Liu (18)

Yifan Yang (18)

Yasuyuki Matsushita (17)

Yue Dong (16)

Jiahao Li (16)

Zinan Lin (16)

Bin Li (15)

Matthew Johnson (15)

Shital Shah (15)

Zhirong Wu (15)

Fangyun Wei (15)

Noel Codella (15)

Victor Bahl (14)

Shikhar Sharma (14)

Hannes Schulz (14)

Dongsheng Li (14)

Ross Cutler (14)

Lei Cui (13)

Martin Grayson (13)

Spencer Fowers (13)

Hoifung Poon (12)

Eric Horvitz (12)

Manik Varma (12)

Wenxuan Xie (12)

Ishani Chakraborty (12)

Yuqing Yang (12)

Qiang Huo (11)

Akshay Nambi (11)

Tengchao Lv (11)

Chung-Ching Lin (11)

Anton Schwaighofer (10)

Ran Gal (10)

Naoto Usuyama (10)

Li Dong (10)

Sheng Zhang (10)

Daniel Coelho de Castro (10)

Aditya Nori (9)

Ann Paradiso (9)

Jonathan M. Carlson (9)

Matthai Philipose (9)

Sumit Basu (9)

Hongzhi Li (9)

Jinglu Wang (9)

Tristan Naumann (9)

Jeffrey Delmerico (9)

Shruthi Bannur (9)

Xinyang Jiang (9)

Vineeth N Balasubramanian (9)

David Sweeney (8)

Michel Galley (8)

Tom Minka (8)

Xun Guo (8)

Luming Liang (8)

Shuohang Wang (8)

Gilles Quentin Hacheme (8)

Girmaw Abebe Tadesse (8)

Sicheng Xu (8)

Will Guyman (8)

Reuben Tan (8)

Smitha Saligrama (8)

Cameron Runde (8)

Nicolas Villar (7)

Venkat Padmanabhan (7)

Anja Thieme (7)

Chris Lovett (7)

Camilla Longden (7)

Stephanie Hyland (7)

Oscar Koller (7)

Ondrej Miksik (7)

Silvano Galliani (7)

Mohit Jain (7)

Tanuja Ganu (7)

Thiago V. Spina (7)

Andrea Britto Mattos Lima (7)

Fatemeh Saleh (7)

Chin-Yew Lin (6)

Dongmei Zhang (6)

Lars Liden (6)

Peter Lee (6)

Richard Banks (6)

Javier Hernandez (6)

Cliff Wong (6)

Kai Qiu (6)

Shaohan Huang (6)

Lei Chu (6)

Yizhong Zhang (6)

Fernando Pérez-García (6)

Simone Fobi Nsutezo (6)

Asma Ben Abacha (6)

Akram Zaytar (6)

Remi Pautrat (6)

A.J. Brush (5)

Andrey Kolobov (5)

Aviv Hurvitz (5)

Dan Bohus (5)

Ece Kamar (5)

Ivan Tashev (5)

Lei Ji (5)

Xiaodong Liu (5)

Sean Andrist (5)

Nipun Kwatra (5)

Amber Hoak (5)

David Tittsworth (5)

Swadheen Shukla (5)

Christoph Vogel (5)

Danqing Huang (5)

Xiao Li (5)

Yixi Xu (5)

Rui Wang (5)

Prof. Darren Cosker (5)

Harkirat Behl (5)

Harshita Sharma (5)

Whitney Hudson (5)

Christopher O'Dowd (5)

Lohit Petikam (5)

Gabriele Goletto (5)

Rita Faia Marques (5)

Zhengyuan Yang (5)

Ashley Feniello (4)

Katja Hofmann (4)

Mike Shepperd (4)

Sanjeev Mehrotra (4)

Sriram Rajamani (4)

Weizhu Chen (4)

Xiulian Peng (4)

Yao Qian (4)

Yifan Gong (4)

Guoxin Wang (4)

Hannah Richardson (nee Murfet) (4)

Nikolaos Karianakis (4)

Yu Shi (4)

Victor Fragoso (4)

Kevin Hsieh (4)

Yang Liu (4)

Shahrzad Gholami (4)

Fanny Nina Paravecino (4)

Hao Cheng (4)

Andrea Tupini (4)

Anthony Cintron Roman (4)

Xiang Ming (4)

Xiaoyi Zhang (4)

Shiqi Jiang (4)

Qianhui Wu (4)

Maximilian Ilse (4)

Yangyu Huang (4)

Caihua Shan (4)

Yifei Shen (4)

Saksham Singhal (4)

Amrita Gupta (4)

Tianyu Ding (4)

Kenza Bouzid (4)

Bodhi Priyantha (3)

Christopher Bishop (3)

Emre Kiciman (3)

Fan Yang (3)

Nicolo Fusi (3)

David Heckerman (3)

John Langford (3)

Kenji Takeda (3)

Kori Inkpen (3)

Henrique S. Malvar (3)

Michel Naim Gerguis (3)

Peter Bodík (3)

Qingwei Lin 林庆维 (3)

Shi Han (3)

Shujie Liu (3)

Siân Lindley (3)

Scott Saponas (3)

Surajit Chaudhuri (3)

Yaobo Liang (3)

Harsha Simhadri (3)

Li Zhao (3)

Lester Mackey (3)

Pat Sweeney (3)

Luiz Belussi (3)

Andromachi Chatzieleftheriou (3)

Qianxi Zhang (3)

P. Anandan (3)

Johnny Johnson (3)

Michael Hansen (3)

Yu Wang (3)

John Stairs (3)

Sheng Zhao (3)

Yansen Wang (3)

Mahdi Rad (3)

Dongqi Han (3)

Zhongqi Miao (3)

Wen-wai Yim (3)

Pashmina Cameron (3)

Ren Yang (3)

Sam Bond-Taylor (3)

Alec Wolman (2)

Amit Sharma (2)

Christian Borgs (2)

Bozidar Radunovic (2)

Jim Gray (2)

Hitesh Ballani (2)

John Helmes (2)

Jinyu Li (2)

Kalika Bali (2)

Karin Strauss (2)

Margus Veanes (2)

Muscle Wu (2)

Vishnu Navda (2)

Qiufeng Yin (2)

Ranveer Chandra (2)

Sarangarajan Parthasarathy (2)

Sean Rintel (2)

Shamsi Iqbal (2)

Shuvendu Lahiri (2)

Vassily Lyutsarev (2)

Sergey Yekhanin (2)

Moshe Lutz (2)

Bichlien Nguyen (2)

Chinmay Singh (2)

Mihaela Vorvoreanu (2)

Scarlett Li (2)

Jimmy Hall (2)

Pratik Ghosh (2)

Neil Tenenholtz (2)

Robert Gmyr (2)

Xiaofei Wang (2)

Ran Gilad-Bachrach (2)

Xiubo Geng (2)

Kevin Kaichuang Yang (2)

Barun Patra (2)

Patrick Misteli (2)

Xia Song (2)

Bill Weeks (2)

Meghana Kshirsagar (2)

Felipe Oviedo (2)

Ashley J. Llorens (2)

Weiwei Yang (2)

Kristen Severson (2)

Ava P. Amini (2)

Robin Abraham (2)

Jayashree Mohan (2)

Victor Ruehle (2)

Alex Lu (2)

Saravan Rajmohan (2)

Jue Zhang (2)

Rogerio Bonatti (2)

Shideh Rezaeifar (2)

Donglin Bai (2)

Scott Freitas (2)

Allen Kim (2)

Jaspreet Bagga (2)

Matheus R. F. Mendonça (2)

Judith Amores (2)

Chandan Singh (2)

Nicholas Jing Yuan (2)

Ade Famoti (2)

Mansi Khemka (2)

Amit Misra (2)

Flora Liu (2)

Guanghui Qin (2)

Juan Manuel Zambrano Chaves (2)

Hui Xue (2)

Baolin Peng (2)

Yuhang He (2)

Thomas Lin (2)

Fabian Falck (2)

Anoop Gupta (1)

Josh Benaloh (1)

Brendan Lucier (1)

Chris Hawblitzel (1)

Chris Quirk (1)

Chris Sienkiewicz (1)

Chuck Needham (1)

Chris White (1)

Scott Counts (1)

Christian Paquin (1)

Chuck Thacker (1)

Daniel Cletheroe (1)

Darren Edge (1)

Dany Rouhana (1)

David Johnston (1)

Doug Burger (1)

Dongdong Zhang (1)

Ethan Jackson (1)

Gabe Cohn (1)

Gordon Bell (1)

E. Glen Weyl (1)

G. Ramalingam (1)

Hannes Gamper (1)

Hsiao-Wuen Hon (1)

Hugh Williams (1)

Íñigo Goiri (1)

Jaron Lanier (1)

Jacki O'Neill (1)

Jennifer Chayes (1)

Jennifer Wortman Vaughan (1)

Jonathan Lester (1)

Jake Hofman (1)

Johannes Gehrke (1)

John Tang (1)

Jonathan Larson (1)

Jack W. Stokes (1)

Karen Easterbrook (1)

Krishna Chintalapudi (1)

Ken Woodberry (1)

Leslie Lamport (1)

Lily Sun (1)

Mark Encarnación (1)

Miro Dudík (1)

Jeremiah (Miah) Wander (1)

Michel Pahud (1)

Nishanth Chandran (1)

Nicole Immorlica (1)

Nikhil Swamy (1)

Pallavi Choudhury (1)

Bo-June (Paul) Hsu (1)

Paolo Costa (1)

Patrick Longa (1)

Rick Rashid (1)

Reuben Olinsky (1)

Ricardo Bianchini (1)

Rich Draves (1)

Robert Gruen (1)

Rick Rogahn (1)

Ryen W. White (1)

Ryota Tomioka (1)

Sharad Agarwal (1)

Santiago Zanella-Béguelin (1)

Sasa Junuzovic (1)

Shobana Balakrishnan (1)

Shuo Chen (1)

Siddhartha Sen (1)

Srinath Setty (1)

Sumit Gulwani (1)

Thomas Karagiannis (1)

ThuVan Pham (1)

Ramarathnam Venkatesan (1)

Vivek Narasayya (1)

Hanna Wallach (1)

Xing Xie (1)

Xin Ma (1)

Yan Huang (1)

Yan Xia (1)

Ben Zorn (1)

Swami Manohar (1)

Stavros Volos (1)

Solon Barocas (1)

Vageesh D C (1)

Paul Smolensky (1)

Matthias Troyer (1)

Nathan Evans (1)

Irene Zhang (1)

Adam Atkinson (1)

Haoyu Dong (1)

Advait Sarkar (1)

Matthew Dixon (1)

Xingdi Yuan (1)

Ted Meeds (1)

Marc-Alexandre Côté (1)

Sunayana Sitaram (1)

Dan R. K. Ports (1)

Dimitra Emmanouilidou (1)

Landon Cox (1)

Karthik Ramachandra (1)

Sebastian Braun (1)

Francesca Parmigiani (1)

James Clegg (1)

Bo Qiao (1)

Boris Köpf (1)

Andrew Paverd (1)

Dr Kiran Muthabatulla (1)

Tal Zaccai (1)

Kate Lytvynets (1)

Sudha Rao (1)

Eduardo Salinas (1)

Lukas Gruber (1)

Lukas Wutschitz (1)

Denny Sun (1)

Shruti Tople (1)

Jiaqi Chu (1)

Mike Walker (1)

Vu Le (1)

Huaying Xue (1)

Xenofon Foukas (1)

Kenichi Kumatani (1)

Brian Caswell (1)

Yiwen Zhu (1)

Rohit Pillai (1)

Yoganand Rajasekaran (1)

Lorin Crawford (1)

Madeleine Daepp (1)

Anna Pavlenko (1)

Joyce Cahoon (1)

Amanda K. Hall (1)

Samuel Chege Maina (1)

Kevin Larson (1)

Iker Llorens (1)

Luis França (1)

Esha Choukse (1)

Gabriela Martinez Sanchez (1)

Mattan Serry (1)

Mario Gini (1)

Vanessa Rodrigues (1)

Harsh Vijay (1)

Millicent Ochieng (1)

Jesús Camacho-Rodríguez (1)

Douglas J. Kelly (1)

Rianne van den Berg (1)

Sameer Segal (1)

Jake Smith (1)

Chang Xu (1)

Serena Hillman (1)

Srinivasan Iyengar (1)

Chenglong Wang (1)

Kali Frost (1)

Jyoti Aneja (1)

Javier Zazo (1)

Luna K. Qiu (1)

Darren Tanner (1)

Giovanni Cherubin (1)

Thomas Roca, PhD (1)

Gust Verbruggen (1)

Srikant Bharadwaj (1)

Yuge Zhang (1)

Tammy Glazer (1)

Lucas A. Meyer (1)

Xiao Liu (1)

Morris Sharp (1)

Burcu Canakci (1)

Menglin Xia (1)

Xin Jin (1)

Chris Parnin (1)

Corby Rosset (1)

Si Qin (1)

Mukul Singh (1)

Sarah Fakhoury (1)

Andres Codas (1)

Saikat Chakraborty (1)

Sarah Smith (1)

Shweti Mahajan (1)

Suraj Jog (1)

Chaojie Zhang (1)

Ursula Hardy (1)

Lucia Ronchi Darre (1)

Stephen Schneider (1)

Xiaoting Qin (1)

Aashaka Shah (1)

Renee St. Amant (1)

Kirill Kalinin (1)

Lev Tankelevitch (1)

Weijian Xu (1)

Andrzej Banburski-Fahey (1)

Arman Salimi (1)

Yupan Huang (1)

Jennifer Marsman (1)

Vivan Amin (1)

Sarah Alamdari (1)

Zongyu Guo (1)

Vidhisha Balachandran (1)

Chuheng Zhang (1)

Carles Domingo-Enrich (1)

Sushrut Karmalkar (1)

Meygha Machado (1)

Varun Jain (1)

Henrik Turbell (1)

Amey Varhade (1)

Hamna . (1)

Galen Mullins (1)

Kevin Qu (1)

Juheon (1)

Wenhui Wang (1)

Zhiliang Peng (1)

Yaoyao Chang (1)

Waqas Zamir (1)

Wassim Hamidouche (1)

Tim Pearce (1)

Ziyu Wan (1)

Carl Chalmers (1)

Maia Stiber (1)

Payod Panda (1)

Rachel Lawrence (1)

Published Date

Video

Holoportation system utilizing Azure Kinects + RGB capture

April 17, 2023 | Spencer Fowers

This video was captured using the new Holoportation system that utilizes Azure Kinects for depth + RGB capture. We have found that the Azure Kinects provide some of the highest quality depth data of any…

0:32

Publication

Visual Instruction Tuning

Haotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae Lee

NeurIPS 2023 | April 2023

Oral Presentation Project Page: https://llava-vl.github.io/

Project

Publication

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Project Project

Publication

A Large-scale Robustness Analysis of Video Action Recognition Models

Madeline Chantry Schiappa, Naman Biyani, Prudvi Kamtam, Shruti Vyas, Hamid Palangi, Vibhav Vineet, Yogesh Rawat

April 2023

Publication

Instruction Tuning with GPT-4

Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao

MSR-TR-2023-35 | April 2023

Published by Microsoft

Project Page: https://instruction-tuning-with-gpt-4.github.io/

Project

Publication

GEMEL: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge

Arthi Padmanabhan , Neil Agarwal , Anand Iyer, Ganesh Ananthanarayanan, Yuanchao Shu, Nikolaos Karianakis, Guoqing Harry Xu , Ravi Netravali

USENIX NSDI | April 2023

Project

Publication

RECL: Responsive Resource-Efficient Continuous Learning for Video Analytics

Mehrdad Khani , Ganesh Ananthanarayanan, Kevin Hsieh, Junchen Jiang , Ravi Netravali , Yuanchao Shu, Mohammad Alizadeh, Victor Bahl

USENIX NSDI | April 2023

Project

3D Telemedicine

Bringing specialized healthcare to rural and underserved communities with live 3D communication Our paper, “Participatory Development of a 3D Telemedicine system during Covid: the future of remote consultations” received the Top Paper award at BAPRAS…

Publication

Universal Few-shot Learning of Dense Prediction Tasks with Visual Token Matching

Donggyun Kim, Jinwoo Kim, Seongwoong Cho, Chong Luo, Seunghoon Hong

ICLR 2023 | March 2023

Outstanding Paper

Video

Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

March 24, 2023

Presented by the Microsoft Health Futures team at CVPR 2023. [Publication] Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

05:38

Computer Vision

Highlights