Skip to main content

Research Repository

Advanced Search

All Outputs (31)

Training an adaptive dialogue policy for interactive learning of visually grounded word meanings (2016)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016, September). Training an adaptive dialogue policy for interactive learning of visually grounded word meanings. Presented at 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Los Angeles, US

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic parsing/generation framework - Dynamic Syntax and Type Theory with Records (DS... Read More about Training an adaptive dialogue policy for interactive learning of visually grounded word meanings.

Interactively learning visually grounded word meanings from a human tutor (2016)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016). Interactively learning visually grounded word meanings from a human tutor. In Proceedings of the 5th Workshop on Vision and Language (48-53)

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic parsing/generation framework - Dynamic Syntax and Type Theory with Records (DS... Read More about Interactively learning visually grounded word meanings from a human tutor.

Interactive learning through dialogue for multimodal language grounding (2015)
Presentation / Conference Contribution
Yu, Y., Lemon, O., & Eshghi, A. (2015). Interactive learning through dialogue for multimodal language grounding. In SemDial 2015, Proceedings of the 19th Workshop on the Semantics and Pragmatics of Dialogue, Gothenburg, Sweden (214-215)

Information density and overlap in spoken dialogue (2015)
Journal Article
Dethlefs, N., Hastie, H., Cuayáhuitl, H., Yu, Y., Rieser, V., & Lemon, O. (2016). Information density and overlap in spoken dialogue. Computer Speech and Language, 37, 82-97. https://doi.org/10.1016/j.csl.2015.11.001

Incremental dialogue systems are often perceived as more responsive and natural because they are able to address phenomena of turn-taking and overlapping speech, such as backchannels or barge-ins. Previous work in this area has often identified disti... Read More about Information density and overlap in spoken dialogue.

Comparing attribute classifiers for interactive language grounding (2015)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2015). Comparing attribute classifiers for interactive language grounding. In Proceedings of the Fourth Workshop on Vision and Language (60-69)

We address the problem of interactively learning perceptually grounded word meanings in a multimodal dialogue system. We design a semantic and visual processing system to support this and illustrate how they can be integrated. We then focus on compar... Read More about Comparing attribute classifiers for interactive language grounding.

Two Alternative Frameworks for Deploying Spoken Dialogue Systems to Mobile Platforms for Evaluation “In the Wild” (2014)
Presentation / Conference Contribution
Hastie, H., Aufaure, M., Alexopoulos, P., Bouchard, H., Cuayáhuitl, H., Dethlefs, N., Gašic, M., Guimeráns, A. G., Henderson, J., Lemon, O., others, & Yu, Y. (2014, September). Two Alternative Frameworks for Deploying Spoken Dialogue Systems to Mobile Platforms for Evaluation “In the Wild”. Presented at 18th Workshop on the Semantics and Pragmatics of Dialogue, Edinburgh

We demonstrate two alternative frameworks for testing and evaluating spoken dialogue systems on mobile devices for use “in the wild”. We firstly present a spoken dialogue system that uses third party ASR (Automatic Speech Recognition) and TTS (Text-T... Read More about Two Alternative Frameworks for Deploying Spoken Dialogue Systems to Mobile Platforms for Evaluation “In the Wild”.

SpeechCity: A Conversational City Guide based on Open Data (2014)
Presentation / Conference Contribution
Rieser, V., Janarthanam, S., Taylor, A., Yu, Y., & Lemon, O. (2014). SpeechCity: A Conversational City Guide based on Open Data. In Proceedings of the 18th Workshop on the Semantics and Pragmatics of Dialogue - Poster Abstracts (234)

The PARLANCE mobile application for interactive search in English and Mandarin (2014)
Presentation / Conference Contribution
Hastie, H., Aufaure, M., Alexopoulos, P., Bouchard, H., Breslin, C., Cuayáhuitl, H., Dethlefs, N., Gasic, M., Henderson, J., Lemon, O., et al., & Yu, Y. (2014, June). The PARLANCE mobile application for interactive search in English and Mandarin. Presented at 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), Philadelphia, PA, US

We demonstrate a mobile application in English and Mandarin to test and evaluate components of the Parlance dialogue system for interactive search under real-world conditions.

Explainable Representations of the Social State: A Model for Social Human-Robot Interactions
Preprint / Working Paper
Hernandez Garcia, D., Yu, Y., Sieinska, W., Part, J. L., Gunson, N., Lemon, O., & Dondrup, C. (2020). Explainable Representations of the Social State: A Model for Social Human-Robot Interactions

In this paper, we propose a minimum set of concepts and signals needed to track the social state during Human-Robot Interaction. We look into the problem of complex continuous interactions in a social context with multiple humans and robots, and disc... Read More about Explainable Representations of the Social State: A Model for Social Human-Robot Interactions.