Artificial Intelligence
Building intelligent machines that complement human reasoning and extend what people can do.
Tool
DeBERTa: Decoding-enhanced BERT with Disentangled Attention
DeBERTa (Decoding-enhanced BERT with disentangled attention) improves the BERT and RoBERTa models using two novel techniques. The first is the disentangled attention mechanism, where each word is represented using two vectors that encode its content…
Tool
VQA Introspect
The VQA-Introspect dataset consists of 238K new perception questions which serve as sub questions corresponding to the set of perceptual tasks needed to effectively answer the complex reasoning questions in the Reasoning split of the…
Publication
Minimax Estimation of Conditional Moment Models
Microsoft Research Blog
XGLUE: Expanding cross-lingual understanding and generation with tasks from real-world scenarios
What we can teach a model to do with natural language is dictated by the availability of data. Currently, we have a lot of labeled data for very few languages, making it difficult to train…
Publication