<?xml version="1.0" standalone="yes"?>
<Paper uid="M93-1018">
  <Title>Japanese ERR UND OVG SUB REC PR E ALL OBJECT S MATCHED ONLY TEXT FILTERING</Title>
  <Section position="5" start_page="213" end_page="214" type="evalu">
    <SectionTitle>
TEST RESULTS AND ANALYSIS
</SectionTitle>
    <Paragraph position="0"> joint-venture domain knowledge base, pragmatic inference rules, and Extract data for template generation .</Paragraph>
    <Paragraph position="1"> We believe that the results do not indicate the potential of our system, since the system performance fo r both languages was still improving after five months of development. Much of the work we did resulted in long-term improvements to our overall text understanding capability, all of which will ensure a stronger base system for future applications . This implies that although the development cycle for data extraction system using a text understanding system may be slower in its current maturity stage, the potential for such a syste m is still unknown and represents a most promising avenue for development . We are particularly pleased wit h the success of our Japanese system : no other Japanese MUC-5 site is using the full understanding approach , but we did as well and our performance continues to improve ) Staff time was the major limiting factor . We needed more time to perform more testing and evaluation l In the 18-month Tipster evaluation, the highest JJV F-measure was about 40 .</Paragraph>
    <Paragraph position="2">  using the scoring program, and to finely tune Extract (template generation) mapping rules . We discovered we were hampered by formatting errors, and in addition considerable information was &amp;quot;understood&amp;quot; by th e system all the way through, but was not extracted by the template generator. Since the discourse modul e was new, it would have been helpful to have additional time to test and expand it . In addition, we neede d more time to fill the OWNERSHIP, REVENUE, and TIME objects, which we simply did not output .</Paragraph>
  </Section>
class="xml-element"></Paper>