Yuqi Wang
Fusing external knowledge resources for natural language understanding techniques: A survey
Wang, Yuqi; Wang, Wei; Chen, Qi; Huang, Kaizhu; Nguyen, Anh; De, Suparna; Hussain, Amir
Authors
Wei Wang
Qi Chen
Kaizhu Huang
Anh Nguyen
Suparna De
Prof Amir Hussain A.Hussain@napier.ac.uk
Professor
Abstract
Knowledge resources, e.g. knowledge graphs, which formally represent essential semantics and information for logic inference and reasoning, can compensate for the unawareness nature of many natural language processing techniques based on deep neural networks. This paper provides a focused review of the emerging but intriguing topic that fuses quality external knowledge resources in improving the performance of natural language processing tasks. Existing methods and techniques are summarised in three main categories: (1) static word embeddings, (2) sentence-level deep learning models, and (3) contextualised language representation models, depending on when, how and where external knowledge is fused into the underlying learning models. We focus on the solutions to mitigate two issues: knowledge inclusion and inconsistency between language and knowledge. Details on the design of each representative method, as well as their strength and limitation, are discussed. We also point out some potential future directions in view of the latest trends in natural language processing research.
Citation
Wang, Y., Wang, W., Chen, Q., Huang, K., Nguyen, A., De, S., & Hussain, A. (2023). Fusing external knowledge resources for natural language understanding techniques: A survey. Information Fusion, 92, 190-204. https://doi.org/10.1016/j.inffus.2022.11.025
Journal Article Type | Article |
---|---|
Acceptance Date | Nov 24, 2022 |
Online Publication Date | Nov 28, 2022 |
Publication Date | 2023-04 |
Deposit Date | Mar 10, 2023 |
Journal | Information Fusion |
Print ISSN | 1566-2535 |
Publisher | Elsevier |
Peer Reviewed | Peer Reviewed |
Volume | 92 |
Pages | 190-204 |
DOI | https://doi.org/10.1016/j.inffus.2022.11.025 |
Keywords | Natural language understanding, Knowledge graph, Knowledge fusion, Representation learning, Deep learning |
You might also like
Machine Un-learning: An Overview of Techniques, Applications, and Future Directions
(2023)
Journal Article
Multi-criteria decision making-based waste management: A bibliometric analysis
(2023)
Journal Article
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search