<?xml version="1.0" standalone="yes"?>
<Paper uid="W01-1208">
  <Title>Question Answering Using Encyclopedic Knowledge Generated from the Web</Title>
  <Section position="8" start_page="4" end_page="4" type="evalu">
    <SectionTitle>
6.2 Results
</SectionTitle>
    <Paragraph position="0"> Table 1 shows the result of our comparative experiment, in which &amp;quot;C&amp;quot; and &amp;quot;A&amp;quot; denote coverage and accuracy, respectively, for variations of our QA system.</Paragraph>
    <Paragraph position="1"> Since all the questions we used are quadruplechoice, in case the system cannot answer the question, random choice can be performed to improve the coverage to 100%.</Paragraph>
    <Paragraph position="2"> Thus, for each knowledge resource we compared cases without/with random choice, which are denoted &amp;quot;w/o Random&amp;quot; and &amp;quot;w/ Random&amp;quot; in  In the case where random choice was not performed, the Web-based encyclopedia noticeably improved the coverage for the Nichigai dictionary, but decreased the accuracy. However, by combining both resources, the accuracy was noticeably improved, and the coverage was comparable with that for the Nichigai dictionary. On the other hand, in the case where random choice was performed, the Nichigai dictionary and the Web-based encyclopedia were comparable in terms of both the coverage and accuracy. Additionally, by combining both resources, the accuracy was further improved.</Paragraph>
    <Paragraph position="3"> We also investigated the performance of our QA system where descriptions related to the computer domain are solely used. For example, the description of &amp;quot;pipeline (transportation pipe)&amp;quot; is in principle irrelevant or misleading to answer questions associated with &amp;quot;pipeline (processing method).&amp;quot; However, coverage/accuracy did not change, because approximately one third of the resultant descriptions were inherently related to the computer domain, and thus those related to minor domains did not affect the result.</Paragraph>
  </Section>
class="xml-element"></Paper>