Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/28518
Title: A new context-dependent term weight computed by boost and discount using relevance information
Authors: Dang, EKF
Luk, RWP 
Allan, J
Ho, KS
Chan, SCF 
Chung, KFL 
Lee, DL
Issue Date: 2010
Publisher: John Wiley & Sons
Source: Journal of the American Society for Information Science and Technology, 2010, v. 61, no. 12, p. 2514-2530 How to cite?
Journal: Journal of the American Society for Information Science and Technology 
Abstract: We studied the effectiveness of a new class of context-dependent term weights for information retrieval. Unlike the traditional term frequency"inverse document frequency (TF"IDF), the new weighting of a term t in a document d depends not only on the occurrence statistics of t alone but also on the terms found within a text window (or "document- context") centered on t. We introduce a Boost and Discount (B&D) procedure which utilizes partial relevance information to compute the context-dependent term weights of query terms according to a logistic regression model. We investigate the effectiveness of the new term weights compared with the context-independent BM25 weights in the setting of relevance feedback. We performed experiments with title queries of the TREC-6, -7, -8, and 2005 collections, comparing the residual Mean Average Precision (MAP) measures obtained using B&D term weights and those obtained by a baseline using BM25 weights. Given either 10 or 20 relevance judgments of the top retrieved documents, using the new term weights yields improvement over the baseline for all collections tested. The MAP obtained with the new weights has relative improvement over the baseline by 3.3 to 15.2%, with statistical significance at the 95% confidence level across all four collections.
URI: http://hdl.handle.net/10397/28518
ISSN: 1532-2882
EISSN: 1532-2890
DOI: 10.1002/asi.21425
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

3
Last Week
0
Last month
0
Citations as of Aug 13, 2017

WEB OF SCIENCETM
Citations

3
Last Week
0
Last month
0
Citations as of Aug 12, 2017

Page view(s)

42
Last Week
2
Last month
Checked on Aug 13, 2017

Google ScholarTM

Check

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.