Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
An Embodied Agent Learning Affordances With Intrinsic Motivations and Solving Extrinsic Tasks With Attention and One-Step Planning
Natl Res Council Italy, Inst Cognit Sci & Technol, Lab Computat Embodied Neurosci, Rome, Italy. .
KTH, School of Engineering Sciences (SCI), Applied Physics.
2019 (English)In: Frontiers in Neurorobotics, ISSN 1662-5218, Vol. 13, article id 45Article in journal (Refereed) Published
Abstract [en]

We propose an architecture for the open-ended learning and control of embodied agents. The architecture learns action affordances and forward models based on intrinsic motivations and can later use the acquired knowledge to solve extrinsic tasks by decomposing them into sub-tasks, each solved with one-step planning. An affordance is here operationalized as the agent's estimate of the probability of success of an action performed on a given object. The focus of the work is on the overall architecture while single sensorimotor components are simplified. A key element of the architecture is the use of "active vision" that plays two functions, namely to focus on single objects and to factorize visual information into the object appearance and object position. These processes serve both the acquisition and use of object-related affordances, and the decomposition of extrinsic goals (tasks) into multiple sub-goals (sub-tasks). The architecture gives novel contributions on three problems: (a) the learning of affordances based on intrinsic motivations; (b) the use of active vision to decompose complex extrinsic tasks; (c) the possible role of affordances within planning systems endowed with models of the world. The architecture is tested in a simulated stylized 2D scenario in which objects need to be moved or "manipulated" in order to accomplish new desired overall configurations of the objects (extrinsic goals). The results show the utility of using intrinsic motivations to support affordance learning; the utility of active vision to solve composite tasks; and the possible utility of affordances for solving utility-based planning problems.

Place, publisher, year, edition, pages
Frontiers Media S.A., 2019. Vol. 13, article id 45
Keywords [en]
open-ended learning, intrinsic motivations, affordance learning, goal-based planning, utility-based planning, active-vision, attention
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:kth:diva-255738DOI: 10.3389/fnbot.2019.00045ISI: 000477746000001Scopus ID: 2-s2.0-85072080843OAI: oai:DiVA.org:kth-255738DiVA, id: diva2:1342409
Note

QC 20190813

Available from: 2019-08-13 Created: 2019-08-13 Last updated: 2019-10-04Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Lord, William
By organisation
Applied Physics
In the same journal
Frontiers in Neurorobotics
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 1 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf