himkt / konoha
๐ฟ An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
โ240Updated 9 months ago
Alternatives and similar repositories for konoha:
Users that are interested in konoha are comparing it to the libraries listed below
- Python version of Sudachi, a Japanese tokenizer.โ402Updated 2 years ago
- A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.โ431Updated 2 months ago
- A Japanese tokenizer based on recurrent neural networksโ396Updated 8 months ago
- Juman++ (a Morphological Analyzer Toolkit)โ384Updated last year
- aim to use JapaneseTokenizer as easy as possibleโ138Updated 5 years ago
- Sentence boundary disambiguation tool for Japanese texts (ๆฅๆฌ่ชๆๅข็ๅคๅฎๅจ)โ189Updated 11 months ago
- Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkakuโ321Updated last month
- natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.โ93Updated 8 months ago
- Unidic packaged for installation via pip.โ87Updated this week
- ๐ A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm informationโ130Updated last year
- A comparison tool of Japanese tokenizersโ120Updated 8 months ago
- An integrated Japanese analyzer based on foundation modelsโ131Updated 5 months ago
- A Japanese NLP Library using spaCy as framework based on Universal Dependenciesโ782Updated 11 months ago
- A lexicon for Sudachiโ243Updated last month
- mecab-python. you can find original version here//taku910.github.io/mecab/โ546Updated 4 months ago
- Japanese text normalizer for mecab-neologdโ278Updated 3 weeks ago
- Japanese word embedding with Sudachi and NWJC ๐ฟโ158Updated last year
- BERT models for Japanese text.โ529Updated 11 months ago
- Emotion analyzer for Japanese textโ114Updated 7 months ago
- Sudachi in Rust ๐ฆ and new generation of SudachiPyโ338Updated last month
- A Python Module for JUMAN++/KNPโ89Updated 2 months ago
- BERT with SentencePiece for Japanese text.โ498Updated 4 years ago
- CaboCha wrapper for Python3โ47Updated 6 years ago
- A small version of UniDic for easy pip installs.โ42Updated 4 years ago
- Lightweight converter from Japanese Kana-kanji sentences into Kana-Roman.โ429Updated 2 years ago
- Kyoto University Web Document Leads Corpusโ80Updated last year
- Notice: This repository will be archived... This repository is for building Windows 64-bit MeCab binary and improving MeCab Python bindinโฆโ252Updated 4 months ago
- A Japanese Tokenizer for Businessโ831Updated last month
- Neologism dictionary based on the language resources on the Web for mecab-unidicโ84Updated 4 years ago
- ๆฅๆฌ่ชT5ใขใใซโ114Updated 5 months ago