polm / unidic-liteLinks
A small version of UniDic for easy pip installs.
โ49Updated 5 years ago
Alternatives and similar repositories for unidic-lite
Users that are interested in unidic-lite are comparing it to the libraries listed below
Sorting:
- Unidic packaged for installation via pip.โ108Updated 11 months ago
- ๐ฟ An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.โ261Updated 9 months ago
- Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japaneseโ38Updated last month
- Yet another sentence-level tokenizer for the Japanese textโ24Updated 2 months ago
- Japanese data from the Google UDT 2.0.โ38Updated 3 months ago
- Yet another Python binding for Juman++/KNP/KWJAโ37Updated last week
- Scripts for creating a Japanese-English parallel corpus and training NMT modelsโ18Updated 4 years ago
- Japanese tokenizer for Transformersโ79Updated 2 years ago
- Sentence boundary disambiguation tool for Japanese texts (ๆฅๆฌ่ชๆๅข็ๅคๅฎๅจ)โ199Updated last year
- Kana-Kanji converter using Mozc dictionaryโ46Updated 11 months ago
- Japanese data from the Google UDT 2.0.โ28Updated 2 years ago
- Utility scripts for preprocessing Wikipedia texts for NLPโ78Updated last year
- The Business Scene Dialogue corpusโ73Updated 4 years ago
- japanese sentence segmentation library for pythonโ73Updated 2 years ago
- A powerful text cleaner for Japanese web textsโ12Updated 2 years ago
- natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.โ95Updated last year
- โ43Updated 2 years ago
- ๆฅๆฌ่ชๆๆณ่ชคใ่จๆญฃใใผใซโ29Updated 3 years ago
- A tool for comparing tokenizersโ120Updated 3 months ago
- A Python Module for JUMAN++/KNPโ92Updated last month
- An integrated Japanese analyzer based on foundation modelsโ138Updated last week
- A Japanese tokenizer based on recurrent neural networksโ412Updated last month
- โ54Updated 2 years ago
- Kyoto University Text Corpusโ68Updated 2 years ago
- A Japanese Parserโ33Updated 2 years ago
- Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkakuโ340Updated this week
- Kyoto University Web Document Leads Corpusโ83Updated 2 years ago
- This repository has implementations of data augmentation for NLP for Japanese.โ64Updated 2 years ago
- Japanese synonym libraryโ55Updated 4 years ago
- ๅ จๅฝๆธ่ชใใผใฟใใไฝๆใใๆฏใไปฎๅใฎใใผใฟใปใใโ28Updated 4 years ago