µTransfer: A technique for hyperparameter tuning of enormous neural networks
Great scientific achievements cannot be made by trial and error alone. Every launch in the space program is underpinned by centuries of fundamental research in aerodynamics, propulsion, and celestial bodies. In the same way, when…
Learning to Walk
Legged locomotion is commonly studied and programmed as a discrete set of structured gait patterns, like walk, trot, gallop. However, studies of children learning to walk (Adolph et al) show that real-world locomotion is often…
Generative Chemistry
The process for developing new drugs is incredibly complex, requiring the evaluation of hundreds of thousands of candidate compounds before a project reaches the clinical trial stage. This process is slow, costly, and requires immense…