<?xml version="1.0" standalone="yes"?>
<Paper uid="W06-0105">
  <Title>Semantic Analysis of Chinese Garden-Path Sentences</Title>
  <Section position="7" start_page="37" end_page="38" type="evalu">
    <SectionTitle>
6. Evaluation and Discussion
</SectionTitle>
    <Paragraph position="0"> To conduct a reliable evaluation, a test sentence set and a simple knowledge base were developed.</Paragraph>
    <Paragraph position="1"> The test set includes 100 manually annotated Chinese garden-path sentences and 100 non garden-path sentences with grammatical structure NP1+v1+NP2+v2+NP3. The knowledge base includes two aspects: one is if the verb is one of VS(pro) or VO(pro), the other is the concepts which the subject/object of the verb favor. And there are about 800 verbs in our knowledge base.</Paragraph>
    <Paragraph position="2"> Next, two experiments have been conducted.</Paragraph>
    <Paragraph position="3"> The first one is designed to test if our model can detect garden-paths effectively. The second one is designed to evaluate if garden-path sentences can be correctly analyzed. The results of the experiments are shown in Tables 1 and 2.</Paragraph>
    <Paragraph position="4">  Where, P is precision ratio, R is recall ratio, and F is F-measure (Fb=1, which is defined as 2PR/(P+R)).</Paragraph>
    <Paragraph position="5"> We can see that on this small test set, our algorithm achieves good performance in detection and analysis of Chinese garden-path sentences.</Paragraph>
    <Paragraph position="6"> We also conducted an error analysis, showing that two main factors lead to detection errors. The first is that attributer processing of NP2's is not considered. For example, inGuan Li Peng You De  Gong Si (manage the friend's company),Peng You De Gong Si (the friend's company) is an NP which cannot be divided to NP21(Peng You friend)+De +NP22(Gong Si company) and cannot be detected if there is an SD type ambiguity.</Paragraph>
    <Paragraph position="7"> The second is coordination ambiguity interacting with NP allocated ambiguity, as in Sandra bumped into the busboy and the waiter told her to be careful, which has not been considered.</Paragraph>
    <Paragraph position="8"> Furthermore, there are two sentences correctly detected as Chinese garden-path sentences, but there are neither SD type ambiguities nor NP allocated ambiguities in them. This is why there are 79 correct detections in Table 1, but only 77 correct analyses in Table 2. One of these sentences is sentence (17), in whichWo Shi Xian Chang (I am the mayor) looks like a prototype SD, however &amp;quot; Shi ...De &amp;quot;is used to emphasizedXian Chang (the mayor) in Chinese.</Paragraph>
    <Paragraph position="9"> (17)Wo Shi Xian Chang Pai Lai De (It is the mayor that instructed me to come here)</Paragraph>
  </Section>
class="xml-element"></Paper>