File Information
File: 05-lr/acl_arc_1_sum/cleansed_text/xml_by_section/abstr/04/c04-1081_abstr.xml
Size: 992 bytes
Last Modified: 2025-10-06 13:43:19
<?xml version="1.0" standalone="yes"?> <Paper uid="C04-1081"> <Title>Chinese Segmentation and New Word Detection using Conditional Random Fields</Title> <Section position="1" start_page="0" end_page="0" type="abstr"> <SectionTitle> Abstract </SectionTitle> <Paragraph position="0"> Chinese word segmentation is a difficult, important and widely-studied sequence modeling problem. This paper demonstrates the ability of linear-chain conditional random fields (CRFs) to perform robust and accurate Chinese word segmentation by providing a principled framework that easily supports the integration of domain knowledge in the form of multiple lexicons of characters and words. We also present a probabilistic new word detection method, which further improves performance.</Paragraph> <Paragraph position="1"> Our system is evaluated on four datasets used in a recent comprehensive Chinese word segmentation competition. State-of-the-art performance is obtained.</Paragraph> </Section> class="xml-element"></Paper>