Machine Intelligence PyTorch Module Zoo
A number of PyTorch modules (neural network components) that are broadly (re)usable. The goal of this release is to provide a library to machine learning researchers to use and advance the state-of-the-art in the area.
Stochastic Mixture-of-Experts
This PyTorch package implements Taming Sparsely Activated Transformer with Stochastic Experts.
Meta Self-training for Few-shot Neural Sequence Labeling [Code]
This is the implementation of the paper Meta Self-training for Few-shot Neural Sequence Labeling. MetaST is short for meta-learning for self-training.
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, the World’s Largest and Most Powerful Generative Language Model
We are excited to introduce the DeepSpeed- and Megatron-powered Megatron-Turing Natural Language Generation model (MT-NLG), the largest and the most powerful monolithic transformer language model trained to date, with 530 billion parameters. It is the…
AI at Scale: Behind the Scenes | OD382
What if you could eliminate the barriers to accelerate innovation? The possibilities for your organization are only limited by the imagination. In this virtual “whiteboard” session David Carmona, GM, AI & Innovation Marketing gives you…