PIRSA:21050001

Video URL

https://pirsa.org/21050001

How to represent part-whole hierarchies in a neural net

Hinton, G. (2021). How to represent part-whole hierarchies in a neural net. Perimeter Institute for Theoretical Physics. https://pirsa.org/21050001

Hinton, Geoffrey. How to represent part-whole hierarchies in a neural net. Perimeter Institute for Theoretical Physics, May. 05, 2021, https://pirsa.org/21050001 

          @misc{ scivideos_PIRSA:21050001,
            doi = {10.48660/21050001},
            url = {https://pirsa.org/21050001},
            author = {Hinton, Geoffrey},
            keywords = {Other Physics},
            language = {en},
            title = {How to represent part-whole hierarchies in a neural net},
            publisher = {Perimeter Institute for Theoretical Physics},
            year = {2021},
            month = {may},
            note = {PIRSA:21050001 see, \url{https://scivideos.org/index.php/pirsa/21050001}}
          }

Geoffrey Hinton University of Toronto

Talk numberPIRSA:21050001
DOI10.48660/21050001
Source RepositoryPIRSA
Collection
Talk Type Scientific Series
Subject

Abstract

I will present a single idea about representation which allows several recent advances in neural networks  to be combined into an imaginary system called GLOM.  GLOM answers the question: How can a neural network with a fixed architecture parse an image into a part-whole hierarchy which has a different structure for each image? The idea is simply to use islands of identical vectors to represent the nodes in the parse tree. The talk will discuss the many ramifications of this idea.  If GLOM can be made to work, it should significantly improve the interpretability of the representations produced by neural nets when applied to vision or language.