Change search
ReferencesLink to record
Permanent link

Direct link
Affordance based word-to-meaning association
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Speech Communication and Technology.ORCID iD: 0000-0002-3323-5311
Show others and affiliations
2009 (English)In: ICRA: 2009 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VDE Verlag GmbH, 2009, 4138-4143 p.Conference paper (Refereed)
Abstract [en]

This paper presents a method to associate meanings to words in manipulation tasks. We base our model on an affordance network, i.e., a mapping between robot actions, robot perceptions and the perceived effects of these actions upon objects. We extend the affordance model to incorporate words. Using verbal descriptions of a task, the model uses temporal co-occurrence to create links between speech utterances and the involved objects, actions and effects. We show that the robot is able form useful word-to-meaning associations, even without considering grammatical structure in the learning process and in the presence of recognition errors. These word-to-meaning associations are embedded in the robot's own understanding of its actions. Thus they can be directly used to instruct the robot to perform tasks and also allow to incorporate context in the speech recognition task.

Place, publisher, year, edition, pages
VDE Verlag GmbH, 2009. 4138-4143 p.
, Proceedings - IEEE International Conference on Robotics and Automation, ISSN 1050-4729
Keyword [en]
Auditory system, Bayesian methods, Context, Human robot interaction, Inference algorithms, Iterative methods, Robot sensing systems, Robotics and automation, Speech recognition, Statistical learning
National Category
Computer Science Language Technology (Computational Linguistics)
URN: urn:nbn:se:kth:diva-52071DOI: 10.1109/ROBOT.2009.5152306ISI: 000276080400131ScopusID: 2-s2.0-70350383489ISBN: 978-1-4244-2788-8OAI: diva2:465365
2009 IEEE International Conference on Robotics and Automation, ICRA '09; Kobe; 12 May 2009 through 17 May 2009
tmh_import_11_12_14 QC 20111220Available from: 2011-12-14 Created: 2011-12-14 Last updated: 2011-12-20Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Salvi, Giampiero
By organisation
Speech Communication and Technology
Computer ScienceLanguage Technology (Computational Linguistics)

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 25 hits
ReferencesLink to record
Permanent link

Direct link