Abu Nowshed Chy
Query expansion for microblog retrieval focusing on an ensemble of features
Chy, Abu Nowshed; Ullah, Md Zia; Aono, Masaki
Abstract
In microblog search, vocabulary mismatch is a persisting problem due to the brevity of tweets and frequent use of unconventional abbreviations. One way of alleviating this problem is to reformulate the query via query expansion. However, finding good expansion terms for a given query is a challenging task. In this paper, we present a query expansion framework, where supervised learning is adopted for selecting expansion terms. Upon retrieving tweets by our proposed topic modeling based query expansion, we utilize the pseudo-relevance feedback and a new temporal relatedness approach to select the candidate tweets. Next, we devise several new features to select the temporally and semantically relevant expansion terms by leveraging the temporal, word embedding, and sentiment association of candidate term and query. Moreover, we also utilize the lexical and twitter specific features to quantify the term relatedness. After supervised feature selection using regularized regression, we estimate the feature importance by applying random forest. Then, we make use of a learning-to-rank (L2R) framework to rank the candidate expansion terms. Results of extensive experiments on TREC Microblog 2011 and 2012 test collections over the Tweets2011 corpus show that our proposed method outperforms the baseline and competitive query expansion methods.
Journal Article Type | Article |
---|---|
Acceptance Date | Oct 2, 2018 |
Publication Date | 2019 |
Deposit Date | Mar 13, 2023 |
Journal | Journal of Information Processing |
Peer Reviewed | Peer Reviewed |
Volume | 27 |
Pages | 61-76 |
DOI | https://doi.org/10.2197/ipsjjip.27.61 |
Keywords | microblog search, query expansion, supervised learning, pseudo-relevance feedback, temporal information retrieval, convolutional long short-term memory, expansion term selection, word embedding |
You might also like
Instruments and Tools to Identify Radical Textual Content
(2022)
Journal Article
Microblog Retrieval Using Ensemble of Feature Sets through Supervised Feature Selection
(2017)
Journal Article
Learning to adaptively rank document retrieval system configurations
(2018)
Journal Article
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search