Graphics and multimedia - Microsoft Research

Video

Keynote: Learning from observation: Small-data approach to human common sense

November 16, 2021 | Katsushi Ikeuchi

Speaker: Katsushi Ikeuchi, Sr. Principal Research Manager, Microsoft Research Redmond Learning-from-Observation (LfO), a robot-teaching paradigm, aims to build a robot system that understands what humans do through a small number of human observations and map…

28:17

Video

Research talks: Few-shot and zero-shot visual learning and reasoning

November 16, 2021 | Kyoung Mu Lee, Han Hu, Zhe Gan

Humans learn, infer, and reason by leveraging prior knowledge without necessarily observing a large number of examples. Visual learning and reasoning technologies, such as few-shot and zero-shot learning, aim to enable human-like learning and reasoning…

29:33

Publication

Learning Fine-Grained Motion Embedding for Landscape Animation

Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo

ACM Multimedia 2021 | October 2021

Oral

Project

Publication

CanvasEmb: Learning Layout Representation with Large-scale Pre-training for Graphic Design

Yuxi Xie, Danqing Huang, Jinpeng Wang, Chin-Yew Lin

Proceedings of the 29th ACM International Conference on Multimedia | October 2021

Publication

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu

ACM Multimedia 2021 | October 2021

Project

Publication

Unifying multimodal transformer for bi-directional image and text generation

Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu

ACM Multimedia 2021 | October 2021

Project

Tool

MeshGraphormer

Research code for ICCV 2021 paper “Mesh Graphormer”

GitHub

Publication

The High-Level Syntax of the Versatile Video Coding (VVC) Standard

Ye-Kui Wang, Robert Skupin, Miska M. Hannuksela, Sachin Deshpande, Hendry, Virginie Drugeon, Rickard Sjöberg, Byeongdoo Choi, Vadim Seregin, Yago Sanchez, Jill M. Boyce, Wade Wan, Gary J. Sullivan

IEEE Transactions on Circuits and Systems for Video Technology | October 2021, Vol 31(10): pp. 3779-3800

Publication

Overview of the Versatile Video Coding (VVC) Standard and its Applications

Benjamin Bross, Ye-Kui Wang, Yan Ye, Shan Liu, Jianle Chen, Gary J. Sullivan, Jens-Rainer Ohm

IEEE Transactions on Circuits and Systems for Video Technology | October 2021, Vol 31(10): pp. 3736-3764

Publication

Going Beyond One-Size-Fits-All Image Descriptions to Satisfy the Information Wants of People Who are Blind or Have Low Vision

Abigale Stangl, Nitin Verma, Kenneth R. Fleischmann, Meredith Ringel Morris, Danna Gurari

ASSETS 2021 | October 2021