<?xml version="1.0" standalone="yes"?>
<Paper uid="C04-1096">
  <Title>Generation of Relative Referring Expressions based on Perceptual Grouping</Title>
  <Section position="6" start_page="3" end_page="3" type="evalu">
    <SectionTitle>
4.2 Results
</SectionTitle>
    <Paragraph position="0"> We checked to what extent the scores of generated expressions given by formula (6) conformed with the human evaluation given by formula (1) as agreement. Agreement was calculated as follows using 20 randomly generated arrangements described in Section 3.2.</Paragraph>
    <Paragraph position="1"> First, the generated expressions were ordered according to the score given by formula (6) and the human evaluation given by formula (1). All binary order relations between two expressions were extracted from these two ordered lists of expressions. The agreement was defined as the ratio of the same binary order relations among all binary order relations. null The agreement between scores and the human evaluation was 45.8%. The score did not predict SOG representations that would generate better expressions very well. Further research is required to conclusively rule out the use of dimension ratios for prediction or whether other factors are involved.</Paragraph>
  </Section>
class="xml-element"></Paper>