Generating and Evaluating Landmark-Based Navigation Instructions in Virtual Environments

Cercas Curry, Amanda; Gkatzia, Dimitra; Rieser, Verena

Abstract

Referring to landmarks has been identified to lead to improved navigation instructions. However, a previous corpus study suggests that human “wizards” also choose to refer to street names and generate user-centric instructions. In this paper, we conduct a task-based evaluation of two systems reflecting the wizards’ behaviours and compare them against an improved version of previous landmark based systems, which resorts to user-centric descriptions if the landmark is estimated to be invisible. We use the GRUVE virtual interactive environment for evaluation. We find that the improved system, which takes visibility into account, outperforms the corpus-based wizard strategies,however not significantly. We also show a significant effect of prior user knowledge, which suggests the usefulness of a user modelling approach.

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: 15th European Workshop on Natural Language Generation (ENLG 2015)
• Start Date: Sep 10, 2015
• End Date: Sep 11, 2015
• Acceptance Date: Sep 11, 2015
• Publication Date: Sep 10, 2015
• Deposit Date: Aug 1, 2016
• Publisher: Association for Computational Linguistics (ACL)
• Pages: 90-94
• Book Title: Proceedings of the 15th European Workshop on Natural Language Generation
• ISBN: 9781941643785
• DOI: https://doi.org/10.18653/v1/w15-4715
• Keywords: Natural Language Generation, NLG, Giving Route Instructions in Uncertain Virtual Environments, GRUVE.
• Public URL: http://researchrepository.napier.ac.uk/Output/321810