Responsible Design & Evaluation of a Conversational Agent for a National Careers Service

Wilson, Marianne; Cruickshank, Peter; Gkatzia, Dimitra; Robertson, Peter

Abstract

This PhD project applies a research-through-design approach to the development of a conversational agent for a national career service for young people. This includes addressing practical, interactional and ethical aspects of the system. For each aspect, the design process will capture requirements, identify potential solutions and evaluation criteria. Delphi study and Wizard of Oz methods will be used to facilitate participation in the design by both domain experts and young people. Both groups will be involved in the evaluation of a prototype based on the design. The research aims to bring together information retrieval, human-computer interaction and AI ethics research to improve understanding of applied NLP for a domain with complex information navigation and ethical requirements.

Citation

Wilson, M., Cruickshank, P., Gkatzia, D., & Robertson, P. (in press). Responsible Design & Evaluation of a Conversational Agent for a National Careers Service.

• Conference Name: Symposium on Future Directions in Information Access (FDIA) 2023
• Conference Location: Vienna, Austria
• Start Date: Sep 1, 2023
• End Date: Sep 1, 2023
• Acceptance Date: Aug 3, 2023
• Deposit Date: Sep 4, 2023
• Publicly Available Date: Sep 4, 2023
• Publisher: CEUR Workshop Proceedings
• Series Title: CEUR Workshop Proceedings
• Keywords: Responsible development, career support, domain expertise, user-centered design, participatory design, Delphi study, Wizard of Oz
• Publisher URL: https://2023.essir.eu/FDIA/papers/FDIA_2023_paper_5.pdf