Skip to main content

Research Repository

Advanced Search

All Outputs (31)

Coronabot: A conversational ai system for tackling misinformation
Presentation / Conference Contribution
Gunson, N., Sieińska, W., Yu, Y., Hernandez Garcia, D., Part, J. L., Dondrup, C., & Lemon, O. (2021, September). Coronabot: A conversational ai system for tackling misinformation. Presented at Conference on Information Technology for Social Good, Roma, Italy

Covid-19 has brought with it an onslaught of information for the public, some true and some false, across virtually every platform. For an individual, the task of sifting through the deluge for reliable, accurate facts is significant and potentially... Read More about Coronabot: A conversational ai system for tackling misinformation.

VOILA: An optimised dialogue system for interactively learning visually-grounded word meanings (demonstration system)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2017, August). VOILA: An optimised dialogue system for interactively learning visually-grounded word meanings (demonstration system). Presented at 18th Annual SIGdial Meeting on Discourse and Dialogue, Saarbrücken, Germany

We present VOILA: an optimised, multi-modal dialogue agent for interactive learning of visually grounded word meanings from a human user. VOILA is: (1) able to learn new visual categories interactively from users from scratch; (2) trained on real hum... Read More about VOILA: An optimised dialogue system for interactively learning visually-grounded word meanings (demonstration system).

Incrementally learning semantic attributes through dialogue interaction
Presentation / Conference Contribution
Vanzo, A., Part, J. L., Yu, Y., Nardi, D., & Lemon, O. (2018, July). Incrementally learning semantic attributes through dialogue interaction. Presented at AAMAS '18: 17th International Conference on Autonomous Agents and MultiAgent Systems, Stockholm, Sweden

Enabling a robot to properly interact with users plays a key role in the effective deployment of robotic platforms in domestic environments. Robots must be able to rely on interaction to improve their behaviour and adaptively understand their operati... Read More about Incrementally learning semantic attributes through dialogue interaction.

A comprehensive evaluation of incremental speech recognition and diarization for conversational AI
Presentation / Conference Contribution
Addlesee, A., Yu, Y., & Eshghi, A. (2020, December). A comprehensive evaluation of incremental speech recognition and diarization for conversational AI. Presented at 28th International Conference on Computational Linguistics, Barcelona, Spain (Online)

Automatic Speech Recognition (ASR) systems are increasingly powerful and more accurate, but also more numerous with several options existing currently as a service (e.g. Google, IBM, and Microsoft). Currently the most stringent standards for such sys... Read More about A comprehensive evaluation of incremental speech recognition and diarization for conversational AI.

Interactively learning visually grounded word meanings from a human tutor
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2016, August). Interactively learning visually grounded word meanings from a human tutor. Presented at 5th Workshop on Vision and Language, Berlin, Germany

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic parsing/generation framework - Dynamic Syntax and Type Theory with Records (DS... Read More about Interactively learning visually grounded word meanings from a human tutor.

Towards visual dialogue for human-robot interaction
Presentation / Conference Contribution
Part, J. L., Hernández García, D., Yu, Y., Gunson, N., Dondrup, C., & Lemon, O. (2021, March). Towards visual dialogue for human-robot interaction. Presented at HRI '21: ACM/IEEE International Conference on Human-Robot Interaction, Boulder, CO, USA

The goal of the EU H2020-ICT funded SPRING project is to develop a socially pertinent robot to carry out tasks in a gerontological healthcare unit. In this context, being able to perceive its environment and have coherent and relevant conversations a... Read More about Towards visual dialogue for human-robot interaction.

Comparing attribute classifiers for interactive language grounding
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2015, September). Comparing attribute classifiers for interactive language grounding. Presented at Fourth Workshop on Vision and Language, Lisbon, Portugal

We address the problem of interactively learning perceptually grounded word meanings in a multimodal dialogue system. We design a semantic and visual processing system to support this and illustrate how they can be integrated. We then focus on compar... Read More about Comparing attribute classifiers for interactive language grounding.

The PARLANCE mobile application for interactive search in English and Mandarin
Presentation / Conference Contribution
Hastie, H., Aufaure, M.-A., Alexopoulos, P., Bouchard, H., Breslin, C., Cuayáhuitl, H., Dethlefs, N., Gasic, M., Henderson, J., Lemon, O., et al., & Yu, Y. (2014, June). The PARLANCE mobile application for interactive search in English and Mandarin. Presented at 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), Philadelphia, PA, US

We demonstrate a mobile application in English and Mandarin to test and evaluate components of the Parlance dialogue system for interactive search under real-world conditions.

Explainable Representations of the Social State: A Model for Social Human-Robot Interactions
Preprint / Working Paper
Hernandez Garcia, D., Yu, Y., Sieinska, W., Part, J. L., Gunson, N., Lemon, O., & Dondrup, C. (2020). Explainable Representations of the Social State: A Model for Social Human-Robot Interactions

In this paper, we propose a minimum set of concepts and signals needed to track the social state during Human-Robot Interaction. We look into the problem of complex continuous interactions in a social context with multiple humans and robots, and disc... Read More about Explainable Representations of the Social State: A Model for Social Human-Robot Interactions.