AI Supremacy

Share this post

What is Microsoft Research's µ-Parametrization?

aisupremacy.substack.com

What is Microsoft Research's µ-Parametrization?

µTransfer: A technique for hyperparameter tuning of enormous neural networks

Michael Spencer
Mar 11, 2022
2
Share this post

What is Microsoft Research's µ-Parametrization?

aisupremacy.substack.com

Microsoft Research has done it again! This is pretty exciting for OpenAI. There’s some suggestion that Microsoft and OpenAI may have solved a fundamental AI bottleneck. So let’s get into it.

The research was published this week on March 8th, 2022 a Tuesday on Microsoft Researcher’s blog.

Microsoft Research Blog

The lead on the study is Edward Hu, a PhD student at Mila, where h…

Keep reading with a 7-day free trial

Subscribe to AI Supremacy to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
Previous
Next
© 2023 Michael Spencer
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing