Computer Vision
Enabling computers and devices to understand what they see.
Video
RetroDepth: Visual-based 3-D sensing and interaction
Watch a demonstration of RetroDepth, a vision-based system that accurately senses the 3-D silhouettes of hands and other objects as they interact on and above physical surfaces.
Project
RetroDepth: 3D Silhouette Sensing for High-Precision Input On and Above Physical Surfaces
We present RetroDepth, a new vision-based system for accurately sensing the 3D silhouettes of hands, styluses, and other objects, as they interact on and above physical surfaces. Our setup is simple, cheap, and easily reproducible,…
Publication
Interactively Stylizing Camera Motion
Video
MonoFusion: Scanning objects in real time with a single web camera
This project offers a method for creating 3-D scans of arbitrary environments in real time, utilizing only a single RGB camera as the input sensor. The camera could be one already available in a tablet…
Project
Microsoft 3-Handpose dataset
We publish a subset of the data from the paper “Discriminative Ferns Ensemble for Hand Pose Recognition”. To receive a download link for the dataset please send your request to ThreeHandPose@microsoft.com. Data description: The data…
Project
Eye-Gaze Tracking for Improved Natural User Interaction
We develop novel eye-gaze tracking technologies in order to make eye-gaze tracking technology ubiquitously available for improved natural user interaction (NUI). In particular, we investigate two approaches: Active IR lighting: We investigate the possibility…