<?xml version="1.0" standalone="yes"?>
<Paper uid="C92-4203">
  <Title>C, TM: An Exmnt)le-Based Translation Aid System</Title>
  <Section position="6" start_page="0" end_page="0" type="evalu">
    <SectionTitle>
5 Evaluation
</SectionTitle>
    <Paragraph position="0"> It is very difficult to evaluate a translation aid system, because its effectiveness essentially depends on the user's satisfaction: when the user feels that the system is helpfld, it is effective. The evaluation of CTM is now in progress, an&lt;l we show some results of experiments here.</Paragraph>
    <Paragraph position="1"> The Retrieval Time F, mpirieally, we ohtaim'd the following equation, which estimates the retriewd time (millisecond).</Paragraph>
    <Paragraph position="2"> time(I,k,N) = I x (D0 x k+2/3 x N) where I is tile length of tile input string, k (mega byte) is the database size, and N is tile we-selection parameter. For example, if/= D0 (characters), k = 8 (mega byte), N = 200, then time = 2,133 (millisecond). It shows that tile current systeln responses ill a few seconds and it is not so fi~st. The more acceleration is need for the larger datah,~e.</Paragraph>
    <Paragraph position="3"> Evaluation of 100 retrievals Wc have evahmted 100 retrieval results I~y hand We have given one of ttle following grades to each retrieved example.</Paragraph>
    <Paragraph position="4"> A The example exactly matches the input.</Paragraph>
    <Paragraph position="5"> B The example provides enough infornmtion about tile translation of the whole input.</Paragraph>
    <Paragraph position="6"> C The examl)le provides information ahout the translation of some part of the input.</Paragraph>
    <Paragraph position="7">  the translation of the input.</Paragraph>
    <Paragraph position="8"> We evalaatod top five examples for each retrieval, and tile hest grade of them is used for the evalnation of a retrievalJ ~ Table 5 shows the result of the evaluation. The table shows that (I) we can obtain very usefill information from 47% of the retrievals, (2) we can obtain at least some information fi'om 81% of the retrievals.</Paragraph>
  </Section>
class="xml-element"></Paper>