Alternatives and similar repositories for chinese-tokenizer

Users that are interested in chinese-tokenizer are comparing it to the libraries listed below

• nieldlr / hanzi
  HanziJS is a Chinese character and NLP module for Chinese language processing for Node.js
  ☆390Updated last year
• chanind / cn-grammar-matcher
  A tool to find grammar patterns in Chinese text
  ☆28Updated 5 years ago
• surrsurus / text-to-ipa
  Text to IPA converter in JavaScript
  ☆58Updated 3 years ago
• peterolson / hanzi-tools
  Converts from Chinese characters to pinyin, between simplified and traditional, and does word segmentation.
  ☆114Updated 2 years ago
• openderocknlp / vocabulary-level-grader
  Analyzes the given text and determine what's the vocabulary level based on CEFR levels
  ☆47Updated 2 years ago
• cburgmer / cjklib
  Han character library for CJKV languages
  ☆163Updated 4 years ago
• CanCLID / canto-filter
  粵文語料篩選器 Cantonese text filter
  ☆41Updated 6 months ago
• Vocab-Apps / python-pinyin-jyutping-sentence
  Convert a Chinese sentence to Pinyin or Jyutping
  ☆64Updated 2 years ago
• openlanguageprofiles / olp-en-cefrj
  Open Language Profiles — English profile datasets from CEFR-J
  ☆151Updated 5 years ago
• g0v / moedict-data-twblg
  臺灣閩南語常用詞辭典 資料檔
  ☆80Updated 2 years ago
• mphilli / English-to-IPA
  Converts English text to IPA notation
  ☆390Updated 2 years ago
• lxs602 / Chinese-Mandarin-Dictionaries
  中文词典 / 中文詞典。Chinese / Chinese-English dictionaries.
  ☆197Updated last year
• kfcd / hyzd
  開放漢語字典 - 現代漢語字音數據庫
  ☆24Updated 4 years ago
• tsroten / hanzidentifier
  Python module that identifies Chinese text as being Simplified or Traditional
  ☆102Updated 10 months ago
• camertron / cldr-segmentation.js
  CLDR text segmentation for JavaScript
  ☆38Updated last year
• skywind3000 / lemma.en
  English Lemma Database - Compiled by Referencing British National Corpus
  ☆32Updated last year
• mhagiwara / cc-kedict
  cc-kedict: Creative Commons Korean-English Dictionary
  ☆41Updated 4 years ago
• hackerb9 / gwordlist
  All the words from Google Books, sorted by frequency
  ☆118Updated 2 years ago
• IlyaSemenov / wikipedia-word-frequency
  Gather modern English word frequencies from all enwiki articles.
  ☆225Updated last year
• jacksonllee / pycantonese
  Cantonese Linguistics and NLP
  ☆391Updated last year
• DannySu09 / supermemo2.js
  Implement the supermemo 2 algorithm.
  ☆81Updated 3 years ago
• takafumir / javascript-lemmatizer
  JavaScript Lemmatizer is a lemmatization library to retrieve a base form from an English inflected word.
  ☆67Updated 4 years ago
• gwinterstein / Cifu
  A frequency lexicon for Hong Kong Cantonese
  ☆23Updated 5 years ago
• nviet / lingoes-converter
  Convert *.LD2 dictionaries format into human-readable text files
  ☆67Updated 12 years ago
• parsimonhi / animCJK
  Draw animated Japanese characters (Kanji and Kana), Korean characters (Hanja) and Chinese characters (Hanzi) in correct stroke order usin…
  ☆347Updated last week
• peterolson / aws-chinese-forced-alignment
  Tool for aligning Chinese transcripts with audio using the AWS transcribe service
  ☆15Updated 3 years ago
• glxxyz / hskhsk.com
  Chinese language vocabulary graph generation. Python/Flask tool that performs dictionary search and analysis on Chinese Hanzi characters.…
  ☆148Updated 2 years ago
• Connum / hanzivg
  Stroke order SVG files for Chinese Hanzi characters
  ☆44Updated 2 years ago
• indiejoseph / hkcc-corpus
  《香港二十世紀中期粵語語料庫》打包器
  ☆16Updated 9 years ago
• lopentu / CwnGraph
  A CWN Python binding with graph structure
  ☆35Updated 2 years ago