<?xml version="1.0" standalone="yes"?>
<Paper uid="C00-1069">
  <Title>Multilinguality in a Text Generation System For Three Slavic Languages Geert-Jan Kruijff a, Elke Teich t', John Bateman ~, Ivana Kruijit;Korbayovfi&amp;quot;,</Title>
  <Section position="6" start_page="479" end_page="479" type="concl">
    <SectionTitle>
5 Evaluation and Conclusions
</SectionTitle>
    <Paragraph position="0"> A first round of evaluation has been carried out on the Agile prototype. This directly assessed the ability of users to control multilin3This description is also valid for Russian, which has a nominal group structure similar to Czech. The 13ulgarian one is more like English.</Paragraph>
    <Paragraph position="1"> gual generation in tile three languages, as well as the design and robustness of the system eom1}onents. Groups of users were given a brief training period and then asked to construct A-boxes expressing given content. Texts were cross-generated: i.e., the languages were w~ried across the A-boxes independently of the native languages of the subjects who created them. Errors were then classified and recommendations for the next and final Agile prototype collected.</Paragraph>
    <Paragraph position="2"> The generated texts were then evaluated by expert technical authors. They were generally judged to be of a broadly similar quality to the texts originating from manuals, and both kinds of texts received similar criticism. The main source of criticism and errors was the design of the GUI which is now being improved for the final prototype. The overall design of the system has theretbre shown itself to offer an etfective approach tbr multilingual generation.</Paragraph>
    <Paragraph position="3"> We are now extending the system to cover a broader range of text types as well as the further grammatical and semantic variation required by the evaluators as well as by the additional text types.</Paragraph>
  </Section>
class="xml-element"></Paper>