<?xml version="1.0" standalone="yes"?>
<Paper uid="C96-1068">
  <Title>A CD-ROM Retrieval System with Multiple Dialogue Agents</Title>
  <Section position="6" start_page="403" end_page="404" type="evalu">
    <SectionTitle>
5 Examinations
</SectionTitle>
    <Paragraph position="0"> In this section, we described the examinations of the prol)osed system. In order to examine the effectiveness of the multiple dialogue agent system (new system), we compare it with the single dialogue agent system (old system). Here the single dialogue agent is the domain agent for the travel domain.</Paragraph>
    <Paragraph position="1"> We evaluated the system by counting the nun&gt; ber of the interactions between the user and the system (Tnrns), the number of inl)ut characters of the users (Characters), and session time (Seconds) that subjects took to reach the same goal with new system and the old one. Eight sul)jects examined these systems. They are all typists, but novices with diah)gue systems. They were given a brief explanation of both systems and practiced on them for about quarter an hour each. We divide</Paragraph>
    <Section position="1" start_page="403" end_page="403" type="sub_section">
      <SectionTitle>
User
Agents
</SectionTitle>
      <Paragraph position="0"> (to ttakone agent and Nikko agent) usrl: Onsen wo sMritai.</Paragraph>
      <Paragraph position="1"> (I want to know the hot springs.) H.agtl: 16 ken arimasu.</Paragraph>
      <Paragraph position="2"> (There are 16 hot springs.) N.agtl: Gh.uuzenji onsen, Nikko gumoto onsen ga ari?~a3,1l,.</Paragraph>
      <Paragraph position="3"> (There are Chuuzenji onsen and Nikko yu- null tile subjects into two groups. Group 1 examined new system first and old one next, and group 2 did old system first and new one next.</Paragraph>
    </Section>
    <Section position="2" start_page="403" end_page="404" type="sub_section">
      <SectionTitle>
5.1 Examination 1
</SectionTitle>
      <Paragraph position="0"> The following goal is given to every subject: Goal 1: You will go to Kurashiki City on business. Find a suitable hotel a. (You may select different hotels with each system.) The relevant agent in the new system is the business trip agent. Table 5 shows the results (averages of Turns, Characters, and Seconds) of examination 1. These results show not only that both groups needed less diMogue using new systeln than using old system, but also that group 1 needed less dialogue, especially less session time (360:640), when they used old system than group 2. This aThere are 41 hotels in Kurasldki City.</Paragraph>
      <Paragraph position="1">  nmans that the user is Mile to learn how to use the old (strategy-less) systenl by using new system with a typical strategy. ~rc also lnenti}m that all six subjects who selected different hotels were happy about the hotel using the new system.</Paragraph>
    </Section>
    <Section position="3" start_page="404" end_page="404" type="sub_section">
      <SectionTitle>
5.2 Examination 2
</SectionTitle>
      <Paragraph position="0"> The following goal is given to every subject: Goal 2: You have to sele(:t Kanazawa or Sendai for sight-seeing. Colnl)are them using some retrieved inlbrlmtti&lt;)n, and seh'ct one.</Paragraph>
      <Paragraph position="1"> The relevant agents in the new systeln arc Kanazawa agent and Scndai agent. Tal)le 6 is the results of examination 2. These results show an interesting phenomenon that in the ca.se of the dialogue comparing multiple goals with these Colnplicared processes, the user tends to stop comparing by session time (from five nfinutes to ten minites) in favour of the obtained retrieval results. And thc new system is able~ to obtain more ret:riewd results than thc old system. Thus the new system is better than the old system in the case of dealing with multil)le goals.</Paragraph>
    </Section>
  </Section>
class="xml-element"></Paper>