Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network

  Advanced Search  

Effective Use of Phrases in Language Modeling to Improve Information Retrieval

Summary: Effective Use of Phrases in Language Modeling to
Improve Information Retrieval
Maojin Jiang, Eric Jensen, Steve Beitzel
Information Retrieval Laboratory
Illinois Institute of Technology
{jianmao, ej, steve}@ir.iit.edu
Shlomo Argamon
Linguistic Cognition Group
Illinois Institute of Technology
Traditional information retrieval models treat the query as a bag of words, assuming that
the occurrence of each query term is independent of the positions and occurrences of
others. Several of these traditional models have been extended to incorporate positional
information, most often through the inclusion of phrases. This has shown improvements
in effectiveness on large, modern test collections. The language modeling approach to
information retrieval is attractive because it provides a well-studied theoretical
framework that has been successful in other fields. Incorporating positional information
into language models is intuitive and has shown significant improvements in several
language-modeling applications. However, attempts to integrate positional information


Source: Argamon, Shlomo - Department of Computer Science, Illinois Institute of Technology


Collections: Computer Technologies and Information Sciences