Does semantics aid syntax? An empirical study on named entity recognition and classification

Zhong, Xiaoshi; Cambria, Erik; Hussain, Amir

Abstract

Many researchers jointly model multiple linguistic tasks (e.g., joint modeling of named entity recognition and named entity classification and joint modeling of syntactic parsing and semantic parsing) with an implicit assumption that these individual tasks can enhance each other via the joint modeling. Before conducting research on jointly modeling multiple tasks, however, such researchers hardly examine whether such assumption is true or not. In this paper, we empirically examine whether named entity classification improves the performance of named entity recognition as an empirical case of examining whether semantics improves the performance of a syntactic task. To this end, we firstly specify the way to determine whether a linguistic task is a syntactic task or a semantic task according to both syntactic theory and semantic theory. After that, we design and conduct extensive experiments on two well-known benchmark datasets using three representative yet diverse state-of-the-art models. Experimental results demonstrate that named entity recognition does not lie at the semantic level and is not a semantic task; instead, it is a syntactic task and that the joint modeling of named entity recognition and classification does not improve the performance of named entity recognition. Experimental results also demonstrate that traditional handcrafted feature models can achieve state-of-the-art performance in comparison with the auto-learned feature model on named entity recognition.

• Journal Article Type: Article
• Acceptance Date: Mar 25, 2021
• Online Publication Date: Apr 10, 2021
• Publication Date: 2022-06
• Deposit Date: May 17, 2021
• Publicly Available Date: Apr 11, 2022
• Journal: Neural Computing and Applications
• Print ISSN: 0941-0643
• Electronic ISSN: 1433-3058
• Publisher: Springer
• Peer Reviewed: Peer Reviewed
• Volume: 34
• Pages: 8373-8384
• DOI: https://doi.org/10.1007/s00521-021-05949-0
• Keywords: Semantics, Syntax, Syntactic task, Named entity recognition, Named entity classification, Named entity recognition and classification
• Public URL: http://researchrepository.napier.ac.uk/Output/2772189