新闻与深度文章
Microsoft has released a new open-source library called DeepSpeed (opens in new tab), which, when combined with its ‘ZeRO’ module can train 100 billion parameter models without using the resources traditionally associated with that.
Transformer-based language generation models have enabled better conversational applications. Though they still have their shortcomings, which were recently exposed by a team at MIT, researchers continue improving them to build better, larger, and more robust models.
新闻报道 | The Register
Meet Clippy 9000: Microsoft brags about building Earth’s largest AI language model, refuses to let it out of the lab
There’s a new giant AI language model in town: enter Microsoft’s Turing-NLG system, which apparently contains a whopping 17 billion parameters, making it the largest publicly known model of its class yet.
新闻报道 | VentureBeat
Microsoft trains world’s largest Transformer language model
Microsoft AI & Research today shared what it calls the largest Transformer-based language generation model ever and open-sourced a deep learning library named DeepSpeed to make distributed training of large models easier.
新闻报道 | InfoWorld
Microsoft speeds up PyTorch with DeepSpeed
Microsoft has released DeepSpeed, a new deep learning optimization library for PyTorch, that is designed to reduce memory use and train models with better parallelism on existing hardware.
新闻报道 | Microsoft Azure Blog
Microsoft makes it easier to build popular language representation model BERT at large scale
Today we are announcing the open sourcing of our recipe to pre-train BERT (Bidirectional Encoder Representations from Transformers) built by the Bing team, including code that works on Azure Machine Learning (opens in new tab), so that customers can unlock the…
新闻报道 | The AI Blog
As search needs evolve, Microsoft makes AI tools for better search available to researchers and developers
Only a few years ago, web search was simple. Users typed a few words and waded through pages of results. Today, those same users may instead snap a picture on a phone and drop it into a search box or…
新闻报道 | Bing Blogs
Towards More Intelligent Search: Deep Learning for Query Semantics
Deep learning is helping to make Bing’s search results more intelligent. Here’s a peek behind the curtain of how we’re applying some of these techniques.
新闻报道 | The AI Blog
Microsoft is teaching systems to read, answer and even ask questions
Microsoft researchers have already created technology that can do two difficult tasks about as well as a person: identify images and recognize words in a conversation. Now, the company’s leading AI experts are working on systems that can do something…