Yann LeCun and A.I. that Mimics the Human Infant Brain
The Metaverse might spawn another kind of artificial intelligence
Just a little note on thoughts I’ve been having this past week.
This week I’ve been thinking about how artificial intelligence will reverse-engineer its own super-intelligence by mimicking the human brain of how an infant learns.
What I think might happen is Quantum computing, Yann LeCun style reinforcement learning, every more impressive supercomputing capabilities, advances in neuroscience, and neuromorphic computing will converge some year in the not-so-distant future (circa 2080).
How we build the Metaverse and create a synthetic AI utopia for A.I to train on might actually enable this convergence. This is nearly akin to us living in a simulation where there are likely trillions of galaxies, and not a few billions like Carl Sagan might have once imagined.
I’m not usually a big Yann LeCun fan, but some of the PR coming out of Meta is starting to make a bit more sense in the grand scheme of things MIT Review (paywalled).
It’s becoming somewhat clear that Facebook’s “Metaverse” is actually their A.I. play as well.
Meta AI @MetaAIToday Meta AI is sharing OPT-175B, the first 175-billion-parameter language model to be made available to the broader AI research community. OPT-175B can generate creative text on a vast range of topics. Learn more & request access: https://t.co/3rTMPms1vq https://t.co/DzjAdbPDLx
The Metaverse Might Spawn a More Independent Learning A.I.
The Metaverse might spawn the next-gen A.I. we’ve all been waiting for and sometimes like to discuss, some form of AGI.
I’m a huge fan of Emily Chang, but this interview was just bizarre to me in her interview with Blake Lemoine.
If you compare the human context to a mouse, you might find that:
The human cerebral cortex houses 1,000 times more neurons than the cerebral cortex of a mouse.
There exists a 2.5-fold increase in interneurons in humans compared to mouse.
While Google has a policy against creating “sentient AI”, some company in the future might not have that policy.
LeCun, VP and chief AI scientist of Meta (formerly Facebook), believes that the next AI revolution will come about when AI systems no longer require supervised learning.
Meanwhile Meta AI has been having an exodus like Google Brain from its ranks. AI systems need to be able to learn from the world with minimal help from humans, LeCun says. Meta like many other companies in BigTech like Tesla and Microsoft, are developing a supercomputer especially for AI Research.
Meta AI’s OPT work is also interesting: https://github.com/facebookresearch/metaseq/tree/main/projects/OPT
The growing interaction between AI and cognitive science with larger language models and faster supercomputers combined with new advances in quantum computing and synthetic AI could lead to new places.
In the end it will likely be A.I. itself that somehow learns how to best reverse-engineer how-to mimic a baby's brain extraordinary ability to self-learn in phases of development and replicate that for itself.
Check out the comment section to his recent piece on Tech Review here.
We sometimes forget that we are just at the nascent phase of the internet, the Cloud, computing capabilities and A.I. research relative to the total lifespan of our species. Whatever Silicon Valley has done or is able to do, soon China will be able to do as well. This East-West competition might actually be good for humanity’s ability to innovate a convergence that would allow the emergence of a human-level A.I. (HLAI) to become a reality.
The Metaverse of the 2030s may not be the right architecture that facilitates this emergence, but it may eventually become that or spawn another architecture that is. In this framework, Facebook’s historical incredible hacking of our attention and consumer data for its Advertising based model might actually lead somewhere good. Meta expects to spend at least $12 Billion a year to facilitate its vision of the Metaverse between 2023 and 2030.
But can Yann LeCun save Facebook with better A.I. where opt-in to the Metaverse will be facilitated?
Some form of machine “common sense” may be closer than we assume.
What do you think?
Thanks for reading!
Join 77 other paying subscribers who get access to premium content and support my growth as an independent Creator. For the price of a coffee, the money goes directly to my basic living expenses.