Combining probabilistic reference resolution with simulated vision

We describe a probabilistic reference disambiguation mechanism developed for a spoken dialogue system mounted on an autonomous robotic agent. Our mechanism processes referring expressions containing intrinsic features of objects (lexical item, colour and size) and locative expressions, which involve...

Full description

Saved in:
Bibliographic Details
Published in2008 International Conference on Intelligent Sensors, Sensor Networks and Information Processing pp. 219 - 224
Main Authors Zukerman, I., Makalic, E., Niemann, M.
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.12.2008
Subjects
Analytical models
Australia
Automatic speech recognition
Color
Context modeling
Image analysis
Information technology
Machine vision
Robot vision systems
Tree graphs
Online AccessGet full text

Cover

More Information
Summary:We describe a probabilistic reference disambiguation mechanism developed for a spoken dialogue system mounted on an autonomous robotic agent. Our mechanism processes referring expressions containing intrinsic features of objects (lexical item, colour and size) and locative expressions, which involve more than one concept. The intended objects are identified in the context of the output of a simulated scene analysis system, which returns the colour and size of the seen objects and a distribution for their type. The evaluation of our system shows high resolution performance across a range of spoken referring expressions and simulated vision accuracies.
ISBN:9781424438228
1424438225
DOI:10.1109/ISSNIP.2008.4761990