Home

About

Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network
FAQHELPSITE MAPCONTACT US


  Advanced Search  

 
On the Effectiveness of Evaluating Retrieval Systems in the Absence of Relevance Judgments
 

Summary: On the Effectiveness of Evaluating Retrieval Systems
in the Absence of Relevance Judgments

Javed A. Aslam
Department of Computer Science
Dartmouth College
jaa@cs.dartmouth.edu
Robert Savell
Department of Computer Science
Dartmouth College
rsavell@cs.dartmouth.edu
ABSTRACT
Soboroff, Nicholas and Cahan recently proposed a method
for evaluating the performance of retrieval systems without
relevance judgments. They demonstrated that the system
evaluations produced by their methodology are correlated
with actual evaluations using relevance judgments in the
TREC competition. In this work, we propose an explana-
tion for this phenomenon. We devise a simple measure for
quantifying the similarity of retrieval systems by assessing

  

Source: Aslam, Javed - College of Computer Science, Northeastern University

 

Collections: Computer Technologies and Information Sciences