ANLP/NAA CL 2000 Workshop 
Reading Comprehension 
Tests as Evaluation for 
Computer-Based Language 
Understanding Systems 
Program Committee 
. Eric Brill, Eugene Charniak, Mary Harper, 
Marc Light (chair), Ellen Riloff, Ellen Voorhees 
May 4, 2000 
Seattle, Washington 
Published by the Association for Computational Linguistics 
NAA CL-ANLP 2000 Workshop 
Reading Comprehension 
Tests as Evaluation for 
Computer-Based Language 
Understanding Systems 
Program Committee 
Eric Bfill, Eugene Charniak, Mary Harper, 
Marc Light (chair), Ellen Riloff, Ellen Voorhees 
May 4, 2000 
Seattle, Washington 
© 2000, Association for Computational Linguistics 
Order additional copies from: 
Association for Computational Linguistics 
75 Paterson Street, Suite 9 
New Brunswick, NJ 08901 USA 
+1-732-342-9100 phone 
+ 1-732-342-9339 fax 
acl@aclweb.org 
TABLE OF CONTENTS 
Reading Comprehension Programs in a Statistical-Language-Processing Class 
Eugene Charniak, Yasemin Altun, Rodfigo de Salvo Braz, 
Benjamin Garrett, Margaret Kosmala, Tomer Moscovich, 
Lixin Pang, Changhee Pyo, Ye Sun, Wei Wy, Zhongfa Yang, 
Shawn Zeller, and Lisa Zorn ........................................................................................................... 1 
Some Challenges of Developing Fully-Automated Systems for Taking Audio Comprehension Exams 
David D. Palmer ............................................................................................................................. 6 
A Rule-based Question Answering System for Reading Comprehension Tests 
Ellen Riloff and Michael Thelen .................................................................................................. 13 
Answer Extraction Towards better Evaluations of NLP Systems 
Rolf Schwitter, Diego Moll~i, Rachel Fournier, and Michael Hess .............................................. 20 
A Question Answering System Developed as a Project in a Natural Language Processing Course 
W. Wang, J. Auer, R. Parasuraman, I. Zubarev, D. Brandyberry, and M.P. Harper .................... 28 
