himkt / konoha
๐ฟ An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
โ243Updated this week
Alternatives and similar repositories for konoha:
Users that are interested in konoha are comparing it to the libraries listed below
- A Japanese tokenizer based on recurrent neural networksโ398Updated 10 months ago
- Python version of Sudachi, a Japanese tokenizer.โ405Updated 2 years ago
- A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.โ441Updated 3 months ago
- Sentence boundary disambiguation tool for Japanese texts (ๆฅๆฌ่ชๆๅข็ๅคๅฎๅจ)โ189Updated last year
- Juman++ (a Morphological Analyzer Toolkit)โ388Updated last year
- ๐ A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm informationโ130Updated 2 years ago
- A comparison tool of Japanese tokenizersโ121Updated 10 months ago
- Unidic packaged for installation via pip.โ93Updated last month
- aim to use JapaneseTokenizer as easy as possibleโ138Updated 6 years ago
- Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkakuโ327Updated 3 months ago
- A Python Module for JUMAN++/KNPโ90Updated last month
- A small version of UniDic for easy pip installs.โ43Updated 4 years ago
- Japanese text normalizer for mecab-neologdโ279Updated last month
- mecab-python. you can find original version here//taku910.github.io/mecab/โ555Updated 5 months ago
- A lexicon for Sudachiโ249Updated 2 months ago
- Sudachi in Rust ๐ฆ and new generation of SudachiPyโ350Updated 3 months ago
- BERT models for Japanese text.โ533Updated last year
- An integrated Japanese analyzer based on foundation modelsโ131Updated this week
- Japanese word embedding with Sudachi and NWJC ๐ฟโ163Updated last year
- ๐ฅ Vaporetto: Very accelerated pointwise prediction based tokenizerโ237Updated 2 weeks ago
- This repository has implementations of data augmentation for NLP for Japanese.โ64Updated 2 years ago
- natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.โ93Updated 10 months ago
- Emotion analyzer for Japanese textโ115Updated 9 months ago
- This repository is archived! The maintained MeCab can be found https://github.com/shogo82148/mecabโ256Updated 6 months ago
- Lightweight converter from Japanese Kana-kanji sentences into Kana-Roman.โ432Updated 2 years ago
- A Japanese NLP Library using spaCy as framework based on Universal Dependenciesโ789Updated last year
- Wikipediaใ็จใใๆฅๆฌ่ชใฎๅบๆ่กจ็พๆฝๅบใใผใฟใปใใโ137Updated last year
- Kyoto University Web Document Leads Corpusโ82Updated last year
- Dictionary based Sentiment Analysis for Japaneseโ94Updated last year
- JGLUE: Japanese General Language Understanding Evaluationโ313Updated 3 weeks ago