Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/19205
Title: Re-examining the effects of adding relevance information in a relevance feedback environment
Authors: Wong, WS
Luk, RWP 
Leong, HV 
Ho, KS
Lee, DL
Keywords: Controlled experiment
Relevance feedback
Vector space model
Issue Date: 2008
Publisher: Pergamon-Elsevier Science Ltd
Source: Information processing and management, 2008, v. 44, no. 3, p. 1086-1116 How to cite?
Journal: Information Processing and Management 
Abstract: This paper presents an investigation about how to automatically formulate effective queries using full or partial relevance information (i.e., the terms that are in relevant documents) in the context of relevance feedback (RF). The effects of adding relevance information in the RF environment are studied via controlled experiments. The conditions of these controlled experiments are formalized into a set of assumptions that form the framework of our study. This framework is called idealized relevance feedback (IRF) framework. In our IRF settings, we confirm the previous findings of relevance feedback studies. In addition, our experiments show that better retrieval effectiveness can be obtained when (i) we normalize the term weights by their ranks, (ii) we select weighted terms in the top K retrieved documents, (iii) we include terms in the initial title queries, and (iv) we use the best query sizes for each topic instead of the average best query size where they produce at most five percentage points improvement in the mean average precision (MAP) value. We have also achieved a new level of retrieval effectiveness which is about 55-60% MAP instead of 40+% in the previous findings. This new level of retrieval effectiveness was found to be similar to a level using a TREC ad hoc test collection that is about double the number of documents in the TREC-3 test collection used in previous works.
URI: http://hdl.handle.net/10397/19205
DOI: 10.1016/j.ipm.2007.12.002
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

9
Last Week
0
Last month
0
Citations as of Jun 25, 2017

WEB OF SCIENCETM
Citations

5
Last Week
0
Last month
0
Citations as of Jun 21, 2017

Page view(s)

39
Last Week
3
Last month
Checked on Jun 25, 2017

Google ScholarTM

Check

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.