Summary: Evaluation of an Ontology-Based
Information Retrieval Tool
and Sandy Reid
Abstract. This paper evaluates the use of an explicit domain on-
tology in an information retrieval tool. The evaluation compares the
performance of ontology-enhanced retrieval with keyword retrieval
for a fixed set of queries across several data sets. The robustness of
the IR approach is assessed by comparing the performance of the tool
on the original data set with that on previously unseen data.
Interest in the evaluation of knowledge-based systems (KBS), knowl-
edge modelling and knowledge acquisition (KA) tools and tech-
niques is growing due to the increased maturity of the field, and to
pressure from funding bodies and commerce for measurable costs
and benefits of knowledge technologies.
KBS researchers have studied the problems of assessing knowl-
edge reuse, the effectiveness of KA tools, and the adequacy of ac-