<?xml version="1.0" standalone="yes"?>
<Paper uid="W99-0404">
  <Title>Multimedia Computer Technology and Performance-Based Language Testing: A Demonstration of the Computerized Oral Proficiency Instrument (COPI)</Title>
  <Section position="3" start_page="21" end_page="22" type="metho">
    <SectionTitle>
6. Opportunities for Interfacing with
Natural Language Processing
</SectionTitle>
    <Paragraph position="0"> Performances on the current version of the COPI are assessed by trained human raters. While the COPI scoring program is designed to improve efficiency in rating, assessing speech performances elicited by the COPI using the criteria of the ACTFL Guidelines remains a labor-intensive effort. The COPI harnesses technology to provide examinees an opportunity to demonstrate their oral proficiency without the labor intensity involved on the part of a test administrator (as compared to the individually administered face-to-face OPI). In a similar manner, we feel that this program provides opportunities for interfacing with natural language processing to provide technological assistance in assessing examinee speech performances. While that discussion is outside the scope of this paper, we feel implementation of oral proficiency assessment, particularly for lower-level learners, would increase were it possible for technology to assist in the evaluation of speech performances. An increase in the practicability of large-scale technologically mediated oral assessments has the potential for a great washback effect in our nation's classrooms to promote the development of oral proficiency in second languages.</Paragraph>
    <Paragraph position="1"> Educational practitioners have long understood that ultimately what gets assessed is what gets taught and practiced.</Paragraph>
    <Paragraph position="2"> Conclusion We believe the COPI offers significant improvements in terms of administration of technologically mediated oral proficiency assessments over tape- or video-mediated assessments. Pilot testing to date indicates that examinees are comfortable with the administration format and understand what is required of them. A validation study is planned for the near future to compare performances on the COPI with those on the SOPI and OPI. Other refinements suggested by the piloting testing are being incorporated into the Arabic and Chinese versions. If such improvements are found to be  helpful through pilot testing, they will be brought into the Spanish version.</Paragraph>
  </Section>
class="xml-element"></Paper>