chinese-tokenizer

Simple algorithm to tokenize Chinese texts into words using CC-CEDICT.

Browse on unpkg