Skip to main content

Research Repository

Advanced Search

All Outputs (7)

Interactively learning visually grounded word meanings from a human tutor (2016)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016). Interactively learning visually grounded word meanings from a human tutor. In Proceedings of the 5th Workshop on Vision and Language (48-53)

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic parsing/generation framework - Dynamic Syntax and Type Theory with Records (DS... Read More about Interactively learning visually grounded word meanings from a human tutor.

Comparing dialogue strategies for learning grounded language from human tutors (2016)
Presentation / Conference Contribution
Yu, Y., Lemon, O., & Eshghi, A. (2016). Comparing dialogue strategies for learning grounded language from human tutors. In Proceedings of the 20th Workshop on the Semantics and Pragmatics of Dialogue (44-54)

We address the problem of interactively learning perceptually grounded word meanings in a multimodal dialogue system. Human tutors can correct, question, and confirm the statements of a dialogue agent which is trying to interactively learn the meanin... Read More about Comparing dialogue strategies for learning grounded language from human tutors.

An Incremental Dialogue System for Learning Visually Grounded Language (demonstration system) (2016)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016). An Incremental Dialogue System for Learning Visually Grounded Language (demonstration system). In Proceedings of the 20th Workshop on the Semantics and Pragmatics of Dialogue (120-121)

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic, and bi-directional grammar framework – Dynamic Syntax and Type Theory with Re... Read More about An Incremental Dialogue System for Learning Visually Grounded Language (demonstration system).

Training an adaptive dialogue policy for interactive learning of visually grounded word meanings (2016)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016). Training an adaptive dialogue policy for interactive learning of visually grounded word meanings. In Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue (339-349). https:/

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic parsing/generation framework - Dynamic Syntax and Type Theory with Records (DS... Read More about Training an adaptive dialogue policy for interactive learning of visually grounded word meanings.