polm / unidic-liteLinks
A small version of UniDic for easy pip installs.
โ49Updated 5 years ago
Alternatives and similar repositories for unidic-lite
Users that are interested in unidic-lite are comparing it to the libraries listed below
Sorting:
- Unidic packaged for installation via pip.โ107Updated 11 months ago
- ๐ฟ An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.โ261Updated 8 months ago
- Yet another sentence-level tokenizer for the Japanese textโ24Updated last month
- Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japaneseโ38Updated 3 weeks ago
- Japanese data from the Google UDT 2.0.โ38Updated 2 months ago
- A powerful text cleaner for Japanese web textsโ12Updated 2 years ago
- Japanese tokenizer for Transformersโ79Updated 2 years ago
- Yet another Python binding for Juman++/KNP/KWJAโ37Updated 2 weeks ago
- The Business Scene Dialogue corpusโ72Updated 4 years ago
- natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.โ95Updated last year
- Japanese synonym libraryโ55Updated 3 years ago
- A tool for comparing tokenizersโ120Updated 2 months ago
- Kana-Kanji converter using Mozc dictionaryโ46Updated 11 months ago
- Sentence boundary disambiguation tool for Japanese texts (ๆฅๆฌ่ชๆๅข็ๅคๅฎๅจ)โ199Updated last year
- japanese sentence segmentation library for pythonโ73Updated 2 years ago
- ๅ จๅฝๆธ่ชใใผใฟใใไฝๆใใๆฏใไปฎๅใฎใใผใฟใปใใโ28Updated 4 years ago
- Utility scripts for preprocessing Wikipedia texts for NLPโ78Updated last year
- Kyoto University Web Document Leads Corpusโ83Updated 2 years ago
- Scripts for creating a Japanese-English parallel corpus and training NMT modelsโ18Updated 4 years ago
- An integrated Japanese analyzer based on foundation modelsโ137Updated 3 weeks ago
- A Python Module for JUMAN++/KNPโ92Updated 2 weeks ago
- โ54Updated 2 years ago
- Japanese data from the Google UDT 2.0.โ28Updated 2 years ago
- aim to use JapaneseTokenizer as easy as possibleโ138Updated 6 years ago
- Japanese-BPEEncoder Version 2โ41Updated 3 years ago
- mecab-python. you can find original version here//taku910.github.io/mecab/โ580Updated 2 months ago
- Annotated Fuman Kaitori Center Corpusโ18Updated 2 years ago
- CaboCha wrapper for Python3โ46Updated 7 years ago
- A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.โ499Updated 3 months ago
- Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkakuโ339Updated this week