Expert system for quality control in bibliographic databases

Journal Article · Sun Jan 01 04:00:00 EST 1989 · J. Am. Soc. Inf. Sci.; (United States)

DOI:https://doi.org/10.1002/(SICI)1097-4571(198901)40:1<1::AID-ASI1>3.0.CO;2-A· OSTI ID:5956594

Todeschini, C; Farrell, M P

An Expert System is presented that can identify errors in the intellectual decisions made by indexers when categorizing documents into an a priori category scheme. The system requires the compilation of a Knowledge Base that incorporates in statistical form the decisions on the linking of indexing and categorization derived from a preceding period of the bibliographic database. New input entering the database is checked against the Knowledge Base, using the descriptor indexing assigned to each record, and the system computed a value for the match of each record with the particular category chosen by the indexer. This category match value is used as a criterion for identifying those documents that have been erroneously categorized. The system was tested on large sample of almost 26,000 documents, representing all the literature falling into ten of the subject categories of the Energy Data Base during the five year period 1980-1984. For valid comparisons among categories, the Knowledge Base must be constructed with an approximately equal number of unique descriptors for each subject category. The system identified those items with high probability of having been erroneously categorized. These items, constituting up to 5% of the sample, were evaluated manually by subject specialists for correct categorization and then compared with the results of the Expert System. Of those pieces of literature deemed by the system to be erroneously categorized, about 75% did indeed belong to a different category. This percentage, however, is dependent on the level at which the threshold on the category match value is set. With a lower threshold value, the percentage can be raised to 90%, but this is accompanied by a lowering of the absolute number of wrongly categorized records caught by the system. The Expert System can be considered as a first step to complete semiautomatic categorizing system.

• Research Organization: International Atomic Energy Agency, Vienna (Austria)
• DOE Contract Number: AC05-84OR21400
• OSTI ID: 5956594
• Journal Information: J. Am. Soc. Inf. Sci.; (United States), Journal Name: J. Am. Soc. Inf. Sci.; (United States) Vol. 40:1; ISSN AISJB
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS
990220* -- Computers
Computerized Models
&amp; Computer Programs-- (1987-1989)
DATA BASE MANAGEMENT
EXPERT SYSTEMS
INFORMATION CENTERS
MANAGEMENT
QUALITY ASSURANCE