Human language technologies
Researching software and systems that bridge the linguistic divide between people and machines to make communicating with computers as natural as speaking with family and friends.
Tool
FreeLB
FreeLB is an adversarial training approach for improving transformer-based language models on Natural Language Understanding tasks. It accumulates the gradient in the ascent steps and updates the parameters with the accumulated gradients, which is approximately…
Publication
Meta-Learning For Few-Shot NMT Adaptation
Publication