Skip to main content

Research Repository

Advanced Search

All Outputs (3)

Interactive learning through dialogue for multimodal language grounding (2015)
Presentation / Conference Contribution
Yu, Y., Lemon, O., & Eshghi, A. (2015). Interactive learning through dialogue for multimodal language grounding. In SemDial 2015, Proceedings of the 19th Workshop on the Semantics and Pragmatics of Dialogue, Gothenburg, Sweden (214-215)

Information density and overlap in spoken dialogue (2015)
Journal Article
Dethlefs, N., Hastie, H., Cuayáhuitl, H., Yu, Y., Rieser, V., & Lemon, O. (2016). Information density and overlap in spoken dialogue. Computer Speech and Language, 37, 82-97. https://doi.org/10.1016/j.csl.2015.11.001

Incremental dialogue systems are often perceived as more responsive and natural because they are able to address phenomena of turn-taking and overlapping speech, such as backchannels or barge-ins. Previous work in this area has often identified disti... Read More about Information density and overlap in spoken dialogue.

Comparing attribute classifiers for interactive language grounding (2015)
Presentation / Conference Contribution
Yu, Y., Eshghi, A., & Lemon, O. (2015). Comparing attribute classifiers for interactive language grounding. In Proceedings of the Fourth Workshop on Vision and Language (60-69)

We address the problem of interactively learning perceptually grounded word meanings in a multimodal dialogue system. We design a semantic and visual processing system to support this and illustrate how they can be integrated. We then focus on compar... Read More about Comparing attribute classifiers for interactive language grounding.