Event
NeurIPS 2024
Microsoft is a proud sponsor of the 38th Conference on Neural Information Processing Systems (opens in new tab) (NeurIPS). This interdisciplinary conference brings together researchers in machine learning, neuroscience, statistics, optimization, computer vision, natural language…
Podcast
Abstracts: NeurIPS 2024 with Weizhu Chen
Next-token prediction trains a language model on all tokens in a sequence. VP Weizhu Chen discusses his team’s 2024 NeurIPS paper on how distinguishing between useful and “noisy” tokens in pretraining can improve token efficiency…