Human-computer interaction
Redefining human experiences through innovations in research, design, and technology.
Video
Hrvoje Benko on what inspires him
In an excerpt from his Microsoft Research Luminaries interview, Senior Researcher Hrvoje Benko discusses his inspiration.
Video
Research as a showcase for what is possible
In an excerpt from his Microsoft Research Luminaries interview, Senior Researcher Hrvoje Benko comments on the role of research.
Video
In-Air Gestures Around Unmodified Mobile Devices
In research led by ETH-Zurich, we present a novel machine learning based algorithm extending the interaction space around mobile devices. The technique uses only the RGB camera now commonplace on off-the-shelf mobile devices. Our algorithm…
Project
Tablet and Stylus Interaction
We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen-and-touch interaction. We can detect whether the user holds the pen in a writing…
Project
Dyadic Mano-a-Mano
Mano-a-Mano is a unique spatial augmented reality system that combines dynamic projection mapping, multiple perspective views and device-less interaction to support face-to-face, or dyadic, interaction with 3D virtual objects. Its main advantage over more traditional…
Video
Handpose: Fully Articulated Hand Tracking
Introducing a new real-time articulated hand tracker which can enable new possibilities for human-computer interaction (HCI). Our system accurately reconstructs complex hand poses across a variety of subjects using only a single depth camera. It…
Project
Fully Articulated Hand Tracking
We present a new real-time articulated hand tracker which can enable new possibilities for human-computer interaction (HCI). Our system accurately reconstructs complex hand poses across a variety of subjects using only a single depth camera.…
Project
RoomAlive
RoomAlive is a proof-of-concept prototype that transforms any room into an immersive, augmented, magical entertainment experience. RoomAlive presents a unified, scalable approach for interactive projection mapping that dynamically adapts content to any room. Users can…