himkt / konohaLinks
๐ฟ An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
โ253Updated 2 months ago
Alternatives and similar repositories for konoha
Users that are interested in konoha are comparing it to the libraries listed below
Sorting:
- A Japanese tokenizer based on recurrent neural networksโ402Updated 2 months ago
- Sentence boundary disambiguation tool for Japanese texts (ๆฅๆฌ่ชๆๅข็ๅคๅฎๅจ)โ193Updated last year
- ๐ A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm informationโ131Updated 2 years ago
- Python version of Sudachi, a Japanese tokenizer.โ406Updated 2 years ago
- A comparison tool of Japanese tokenizersโ121Updated last year
- A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.โ461Updated last month
- An integrated Japanese analyzer based on foundation modelsโ133Updated last week
- mecab-python. you can find original version here//taku910.github.io/mecab/โ564Updated 8 months ago
- aim to use JapaneseTokenizer as easy as possibleโ139Updated 6 years ago
- Japanese tokenizer for Transformersโ79Updated last year
- Kyoto University Web Document Leads Corpusโ83Updated last year
- natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.โ94Updated last year
- A small version of UniDic for easy pip installs.โ43Updated 4 years ago
- Juman++ (a Morphological Analyzer Toolkit)โ393Updated last year
- japanese sentence segmentation library for pythonโ71Updated 2 years ago
- Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkakuโ330Updated 6 months ago
- This repository has implementations of data augmentation for NLP for Japanese.โ64Updated 2 years ago
- A lexicon for Sudachiโ256Updated 2 months ago
- Japanese word embedding with Sudachi and NWJC ๐ฟโ167Updated last year
- lists of text corpus and more (mainly Japanese)โ117Updated 11 months ago
- Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japaneseโ37Updated 7 months ago
- Kyoto University Text Corpusโ63Updated 2 years ago
- BERT models for Japanese text.โ533Updated last year
- Japanese text normalizer for mecab-neologdโ280Updated 4 months ago
- Japanese synonym libraryโ53Updated 3 years ago
- Japanese data from the Google UDT 2.0.โ38Updated last month
- Dictionary based Sentiment Analysis for Japaneseโ95Updated last year
- A Python Module for JUMAN++/KNPโ91Updated last month
- Wikipediaใ็จใใๆฅๆฌ่ชใฎๅบๆ่กจ็พๆฝๅบใใผใฟใปใใโ141Updated last year
- Sudachi in Rust ๐ฆ and new generation of SudachiPyโ365Updated 3 weeks ago