WorksApplications / SudachiPyLinks
Python version of Sudachi, a Japanese tokenizer.
☆413Updated 2 years ago
Alternatives and similar repositories for SudachiPy
Users that are interested in SudachiPy are comparing it to the libraries listed below
Sorting:
- mecab-python. you can find original version here//taku910.github.io/mecab/☆569Updated 11 months ago
- A Japanese NLP Library using spaCy as framework based on Universal Dependencies☆809Updated last year
- A Japanese tokenizer based on recurrent neural networks☆405Updated 5 months ago
- Juman++ (a Morphological Analyzer Toolkit)☆397Updated 2 years ago
- A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.☆478Updated 4 months ago
- Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku☆333Updated 2 months ago
- 🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.☆255Updated 5 months ago
- A lexicon for Sudachi☆261Updated last month
- Japanese text normalizer for mecab-neologd☆285Updated 6 months ago
- BERT models for Japanese text.☆536Updated last year
- Japanese morphological analysis engine written in pure Python☆891Updated 7 months ago
- Japanese word embedding with Sudachi and NWJC 🌿☆166Updated last year
- Sudachi in Rust 🦀 and new generation of SudachiPy☆384Updated 3 months ago
- This repository is archived! The maintained MeCab can be found https://github.com/shogo82148/mecab☆261Updated 11 months ago
- A Japanese Tokenizer for Business☆895Updated 3 months ago
- Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)☆193Updated last year
- A Python Module for JUMAN++/KNP☆91Updated 3 months ago
- Lightweight converter from Japanese Kana-kanji sentences into Kana-Roman.☆438Updated 3 years ago
- A comparison tool of Japanese tokenizers☆121Updated last year
- BERT with SentencePiece for Japanese text.☆496Updated 4 years ago
- Neologism dictionary based on the language resources on the Web for mecab-unidic☆86Updated 5 years ago
- aim to use JapaneseTokenizer as easy as possible☆139Updated 6 years ago
- An integrated Japanese analyzer based on foundation models☆135Updated this week
- Emotion analyzer for Japanese text☆115Updated last year
- natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.☆94Updated last year
- A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese☆847Updated this week
- Wikipediaを用いた日本語の固有表現抽出データセット☆141Updated 2 years ago
- Code for producing Japanese pretrained models provided by rinna Co., Ltd.☆576Updated 2 years ago
- JGLUE: Japanese General Language Understanding Evaluation☆322Updated 6 months ago
- 日本語T5モデル☆116Updated 2 weeks ago