Dr Dimitra Gkatzia D.Gkatzia@napier.ac.uk
Associate Professor
In this paper we present a snapshot of endto-end NLG system evaluations as presented in conference and journal papers1 over the last ten years in order to better understand the nature and type of evaluations that have been undertaken. We find that researchers tend to favour specific evaluation methods, and that their evaluation approaches are also correlated with the publication venue. We further discuss what factors may influence the types of evaluation used for a given NLG system.
Gkatzia, D., & Mahamood, S. (2015, September). A Snapshot of NLG Evaluation Practices 2005 - 2014. Presented at Proceedings of the 15th European Workshop on Natural Language Generation (ENLG), University of Brighton Brighton, UK
Presentation Conference Type | Conference Paper (published) |
---|---|
Conference Name | Proceedings of the 15th European Workshop on Natural Language Generation (ENLG) |
Start Date | Sep 10, 2015 |
End Date | Sep 11, 2015 |
Acceptance Date | Sep 10, 2015 |
Publication Date | Sep 10, 2015 |
Deposit Date | Aug 1, 2016 |
Publisher | Association for Computational Linguistics (ACL) |
Pages | 57-60 |
ISBN | 9781941643785 |
DOI | https://doi.org/10.18653/v1/w15-4708 |
Keywords | Natural Language Generation, evaluation methods. |
Public URL | http://researchrepository.napier.ac.uk/Output/321807 |
Data-to-Text Generation Improves Decision-Making Under Uncertainty
(2017)
Journal Article
Multi-adaptive Natural Language Generation using Principal Component Regression
(2014)
Presentation / Conference Contribution
The REAL corpus
(2016)
Data
Monitoring Users’ Behavior: Anti-Immigration Speech Detection on Twitter
(2020)
Journal Article
Opportunities and risks in the use of AI in career development practice
(2022)
Journal Article
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
Apache License Version 2.0 (http://www.apache.org/licenses/)
Apache License Version 2.0 (http://www.apache.org/licenses/)
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2025
Advanced Search