Experiment Exchange

SigOpt

From SigOpt, Experiment Exchange is where we find out how the latest developments in AI are transforming our world. Host and SigOpt Head of Engineering Michael McCourt interviews researchers, industry leaders, and other technical experts about their work in AI, ML, and HPC — asking the hard questions we all want answers to. read less
TechnologyTechnology
ScienceScience
MathematicsMathematics

Episodes

How Numenta Builds Neural Networks Inspired by Sparsity in the Human Brain
21-06-2022
How Numenta Builds Neural Networks Inspired by Sparsity in the Human Brain
Our brains only use about 30-40 watts of power, yet are more powerful than neural networks which take extensive amounts of energy to run. So what can we learn from the brain to help us build better neural networks? Join Michael McCourt as he interviews Subutai Ahmad, VP of Research at Numenta, about his latest work.In this episode, they discuss sparsity, bioinspiration, and how Numenta is using SigOpt to help them build better neural networks and save on training costs.1:31 - Background on Numenta2:31 - Bioinspiration3:47 - Numenta's three research areas4:06 - What is sparsity and how does it function in the brain?7:15 - Training costs, Moore's Law, and how deep learning systems are on a different curve9:58 - Mismatch between hardware and algorithms today in deep learning11:04 - Improving energy usage and speed with sparse networks14:10 - Sparse networks work with different hyperparameter regimes than dense networks14:18 - How Numenta uses SigOpt Multimetric optimization15:48 - How Numenta uses SigOpt Multitask to constrain costs18:06 - How Numenta chose their hyperparameters19:40 - What's next from NumentaLearn more about Numenta at numenta.com and follow them on YouTube at www.youtube.com/c/NumentaTheoryRead Jeff Hawkin's book, A Thousand Brains: A New Theory of IntelligenceLearn more about SigOpt at sigopt.com and follow us on Twitter at twitter.com/sigoptSubscribe to our YouTube channel to watch Experiment Exchange interviews at www.youtube.com/channel/sigopt