<?xml version="1.0" standalone="yes"?>
<Paper uid="H94-1018">
  <Title>TOWARDS BETTER NLP SYSTEM EVALUATION</Title>
  <Section position="3" start_page="0" end_page="0" type="intro">
    <SectionTitle>
1. Introduction
</SectionTitle>
    <Paragraph position="0"> There is a manifest need for a good evaluation methodology for (S&amp;)NLP systems. This paper presents such a methodology, indicating its key elements under the headings of performance factors, evaluation gauges, test data, and assessment strategy, and illustrating its application.</Paragraph>
    <Paragraph position="1"> The paper is based on Galliers and Sparck Jones (1993), which offers a comprehensive analysis of what is involved and needed in NLP evaluation, supplemented by an extensive review of methodologies that have already been proposed or applied, and also refers to evaluation experience in the neighbouring information retrieval (IR) field.</Paragraph>
  </Section>
class="xml-element"></Paper>