Human-computer interaction
Redefining human experiences through innovations in research, design, and technology.
Video
RetroDepth: Visual-based 3-D sensing and interaction
Watch a demonstration of RetroDepth, a vision-based system that accurately senses the 3-D silhouettes of hands and other objects as they interact on and above physical surfaces.
Project
A Low-cost Transparent Electric Field Sensor for 3D Interaction on Mobile Devices
We contribute a thin, transparent, and low-cost design for electric field sensing, allowing for 3D finger and hand tracking, as well as in-air gestures on mobile devices. Our approach requires no direct instrumentation of the…
Project
Type–Hover–Swipe in 96 Bytes: A Motion Sensing Mechanical Keyboard
We present a new type of augmented mechanical keyboard, sensing rich and expressive motion gestures performed both on and directly above the device. A low-resolution matrix of infrared (IR) proximity sensors is interspersed with the…
Project
RetroDepth: 3D Silhouette Sensing for High-Precision Input On and Above Physical Surfaces
We present RetroDepth, a new vision-based system for accurately sensing the 3D silhouettes of hands, styluses, and other objects, as they interact on and above physical surfaces. Our setup is simple, cheap, and easily reproducible,…
Video
SurroundWeb: Spreading the Web to Multiple Screens
Projectors, tablets, and other devices, combined with depth cameras, enable applications to span multiple “screens.” This work enables webpages to be experienced outside of your PC monitors to take advantage of all your devices in…
