The Task2Dial Dataset: A Novel Dataset for Commonsense-enhanced Task-based Dialogue Grounded in Documents

Strathearn, Carl; Gkatzia, Dimitra

Abstract

This paper describes the Task2Dial dataset, a novel dataset of document-grounded task-based dialogues in the food preparation domain , where an Information Giver (IG) provides instructions to an Information Follower (IF) so that the latter can successfully complete the task. In this novel setting, the IF can ask clarification questions which might not be able to be grounded in the underlying document and might require commonsense knowledge to be answered. The Task2Dial dataset poses new challenges: (1) its human reference texts show more lexical richness and variation than other document-grounded dialogue datasets; (2) generating from this set requires paraphrasing as instructional responses have been modified from the underlying recipe; (3) and commonsense knowledge, since questions might not necessarily be grounded in the document ; (4) generating requires planning based on context, as recipe steps need to be provided in order. As such, learning from this dataset promises more natural, varied and less template-like system utterances. The dataset contains dialogues with an average 18.15 number of turns and 19.79 tokens per turn, as compared to 12.94 and 12 respectively in existing datasets. Finally, we also provide a data statement , and we discuss the challenges associated with this novel task/dataset.

Citation

Strathearn, C., & Gkatzia, D. (2021). The Task2Dial Dataset: A Novel Dataset for Commonsense-enhanced Task-based Dialogue Grounded in Documents. In Proceedings of The Fourth International Conference on Natural Language and Speech Processing (ICNLSP 2021) (242-251)

• Conference Name: 4th International Conference on Natural Language and Speech Processing (ICNLSP 2021)
• Conference Location: Trento, Italy [Online]
• Start Date: Nov 12, 2021
• End Date: Nov 13, 2021
• Acceptance Date: Oct 1, 2021
• Publication Date: 2021
• Deposit Date: Oct 4, 2021
• Publicly Available Date: Jan 1, 2023
• Publisher: Association for Computational Linguistics (ACL)
• Pages: 242-251
• Book Title: Proceedings of The Fourth International Conference on Natural Language and Speech Processing (ICNLSP 2021)
• Public URL: http://researchrepository.napier.ac.uk/Output/2807732
• Publisher URL: https://aclanthology.org/2021.icnlsp-1.28/