<?xml version="1.0" standalone="yes"?>
<Paper uid="P04-1079">
  <Title>Extending the BLEU MT Evaluation Method with Frequency Weightings</Title>
  <Section position="1" start_page="0" end_page="0" type="abstr">
    <SectionTitle>
Abstract
</SectionTitle>
    <Paragraph position="0"> We present the results of an experiment on extending the automatic method of</Paragraph>
    <Section position="1" start_page="0" end_page="0" type="sub_section">
      <SectionTitle>
Machine Translation evaluation BLUE
</SectionTitle>
      <Paragraph position="0"> with statistical weights for lexical items, such as tf.idf scores. We show that this extension gives additional information about evaluated texts; in particular it allows us to measure translation Adequacy, which, for statistical MT systems, is often overestimated by the baseline BLEU method. The proposed model uses a single human reference translation, which increases the usability of the proposed method for practical purposes. The model suggests a linguistic interpretation which relates frequency weights and human intuition about translation Adequacy and Fluency.</Paragraph>
    </Section>
  </Section>
class="xml-element"></Paper>