Skip to main content

Research Repository

Advanced Search

All Outputs (7)

Interactively learning visually grounded word meanings from a human tutor (2016)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016, August). Interactively learning visually grounded word meanings from a human tutor. Presented at 5th Workshop on Vision and Language, Berlin, Germany

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic parsing/generation framework - Dynamic Syntax and Type Theory with Records (DS... Read More about Interactively learning visually grounded word meanings from a human tutor.

Comparing dialogue strategies for learning grounded language from human tutors (2016)
Presentation / Conference Contribution
Yu, Y., Lemon, O., & Eshghi, A. (2016, July). Comparing dialogue strategies for learning grounded language from human tutors. Presented at 20th Workshop Series on the Semantics and Pragmatics of Dialogue 201, New Brunswick, US

We address the problem of interactively learning perceptually grounded word meanings in a multimodal dialogue system. Human tutors can correct, question, and confirm the statements of a dialogue agent which is trying to interactively learn the meanin... Read More about Comparing dialogue strategies for learning grounded language from human tutors.

An Incremental Dialogue System for Learning Visually Grounded Language (demonstration system) (2016)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016, July). An Incremental Dialogue System for Learning Visually Grounded Language (demonstration system). Presented at 20th Workshop Series on the Semantics and Pragmatics of Dialogue 2016, New Brunswick, US

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic, and bi-directional grammar framework – Dynamic Syntax and Type Theory with Re... Read More about An Incremental Dialogue System for Learning Visually Grounded Language (demonstration system).

Training an adaptive dialogue policy for interactive learning of visually grounded word meanings (2016)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016, September). Training an adaptive dialogue policy for interactive learning of visually grounded word meanings. Presented at 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Los Angeles, US

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic parsing/generation framework - Dynamic Syntax and Type Theory with Records (DS... Read More about Training an adaptive dialogue policy for interactive learning of visually grounded word meanings.