Dr Yanchao Yu Y.Yu@napier.ac.uk
Lecturer
Comparing dialogue strategies for learning grounded language from human tutors
Yu, Yanchao; Lemon, Oliver; Eshghi, Arash
Authors
Oliver Lemon
Arash Eshghi
Abstract
We address the problem of interactively learning perceptually grounded word meanings in a multimodal dialogue system. Human tutors can correct, question, and confirm the statements of a dialogue agent which is trying to interactively learn the meanings of perceptual words, e.g.\ colours and shapes.
We show that different learner and tutor dialogue strategies lead to different learning rates, accuracy of learned meanings, and effort/costs for human tutors. For example, we show that a learner which can handle corrections in dialogue, and its own uncertainty about what it sees, can learn meanings that are as accurate as a fully-supervised learner, but with less cost/effort to the human tutor.
Presentation Conference Type | Conference Paper (Published) |
---|---|
Conference Name | 20th Workshop Series on the Semantics and Pragmatics of Dialogue 201 |
Start Date | Jul 16, 2016 |
End Date | Jul 18, 2016 |
Publication Date | 2016 |
Deposit Date | Jun 29, 2023 |
Pages | 44-54 |
Book Title | Proceedings of the 20th Workshop on the Semantics and Pragmatics of Dialogue |
You might also like
The PARLANCE mobile application for interactive search in English and Mandarin
(2014)
Presentation / Conference Contribution
Comparing attribute classifiers for interactive language grounding
(2015)
Presentation / Conference Contribution
Towards visual dialogue for human-robot interaction
(2021)
Presentation / Conference Contribution
Interactively learning visually grounded word meanings from a human tutor
(2016)
Presentation / Conference Contribution
A comprehensive evaluation of incremental speech recognition and diarization for conversational AI
(2020)
Presentation / Conference Contribution
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search