Learning programs is better than learning dynamics: A programmable neural network hierarchical architecture in a multi-task scenario
2015 (English)In: Adaptive Behavior, ISSN 1059-7123, E-ISSN 1741-2633, Vol. 24, no 1, 27-51 p.Article in journal (Refereed) Published
Distributed and hierarchical models of control are nowadays popular in computational modeling and robotics. In the artificial neural network literature, complex behaviors can be produced by composing elementary building blocks or motor primitives, possibly organized in a layered structure. However, it is still unknown how the brain learns and encodes multiple motor primitives, and how it rapidly reassembles, sequences and switches them by exerting cognitive control. In this paper we advance a novel proposal, a hierarchical programmable neural network architecture, based on the notion of programmability and an interpreter-programmer computational scheme. In this approach, complex (and novel) behaviors can be acquired by embedding multiple modules (motor primitives) in a single, multi-purpose neural network. This is supported by recent theories of brain functioning in which skilled behaviors can be generated by combining functional different primitives embedded in âreusableâ areas of ârecycledâ neurons. Such neuronal substrate supports flexible cognitive control, too. Modules are seen as interpreters of behaviors having controlling input parameters, or programs that encode structures of networks to be interpreted. Flexible cognitive control can be exerted by a programmer module feeding the interpreters with appropriate input parameters, without modifying connectivity. Our results in a multiple T -maze robotic scenario show how this computational framework provides a robust, scalable and flexible scheme that can be iterated at different hierarchical layers permitting to learn, encode and control multiple qualitatively different behaviors.
Place, publisher, year, edition, pages
2015. Vol. 24, no 1, 27-51 p.
Programming neural networks, hierarchical organization, distributed representation, neuronal reuse, cognitive control
Other Computer and Information Science Other Computer and Information Science
IdentifiersURN: urn:nbn:se:kth:diva-177627DOI: 10.1177/1059712315609412ISI: 000370374700003ScopusID: 2-s2.0-84957824197OAI: oai:DiVA.org:kth-177627DiVA: diva2:873772
QC 20160211. QC 201603192015-11-242015-11-242016-03-19Bibliographically approved