Home

About

Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network
FAQHELPSITE MAPCONTACT US


  Advanced Search  

 
Using a Grammar Checker for Evaluation and Postprocessing of Statistical Machine Translation
 

Summary: Using a Grammar Checker for Evaluation and Postprocessing of Statistical
Machine Translation
Sara Stymne, Lars Ahrenberg
Department of Computer and Information Science
Link¨oping University, Sweden
{sarst,lah}@ida.liu.se
Abstract
One problem in statistical machine translation (SMT) is that the output often is ungrammatical. To address this issue, we have investi-
gated the use of a grammar checker for two purposes in connection with SMT: as an evaluation tool and as a postprocessing tool. As an
evaluation tool the grammar checker gives a complementary picture to standard metrics such as Bleu, which do not account for gram-
maticality. We use the grammar checker as a postprocessing tool by applying the error correction suggestions it gives. There are only
small overall improvements of the postprocessing on automatic metrics, but the sentences that are affected by the changes are improved,
as shown both by automatic metrics and by a human error analysis. These results indicate that grammar checker techniques are a useful
complement to SMT.
1. Introduction
One problem with standard statistical machine translation
systems is that their output tends to be ungrammatical,
since there generally is no linguistic knowledge used in the
systems. We investigate how a grammar checker can be
used to address this issue. Grammar checkers are devel-

  

Source: Ahrenberg, Lars - Department of Computer and Information Science, Linköpings Universitet

 

Collections: Computer Technologies and Information Sciences