Developing a new statistical method for Chinese text segmentation

• 主要作者: Dai, Yubin
• 其他作者: Khoo, Christopher Soo Guan
• 格式: Theses and Dissertations
• 出版: 2008
• 主題: DRNTU::Engineering::Computer science and engineering::Computing methodologies::Pattern recognition; DRNTU::Engineering::Computer science and engineering::Theory of computation::Analysis of algorithms and problem complexity
• 在線閱讀: http://hdl.handle.net/10356/2614

A new statistical formula for Chinese text segmentation called Contextual Information Formula (OF) was developed empirically for identifying 2 and 3-character words. It was developed by performing stepwise logistic regression using a sample of sentences that had been manually segmented. 300 sentence...