A Japanese Tokenizer for Business
☆940Jun 17, 2025Updated 8 months ago
Alternatives and similar repositories for Sudachi
Users that are interested in Sudachi are comparing it to the libraries listed below
Sorting:
- Python version of Sudachi, a Japanese tokenizer.☆427Oct 7, 2022Updated 3 years ago
- A lexicon for Sudachi☆279Jan 20, 2026Updated last month
- The Japanese analysis plugin for elasticsearch☆218Feb 19, 2026Updated last week
- A Japanese NLP Library using spaCy as framework based on Universal Dependencies☆832Mar 30, 2024Updated last year
- Sudachi in Rust 🦀 and new generation of SudachiPy☆427Jan 7, 2026Updated last month
- Neologism dictionary based on the language resources on the Web for mecab-ipadic☆2,788Dec 27, 2023Updated 2 years ago
- Japanese word embedding with Sudachi and NWJC 🌿☆170Mar 1, 2024Updated 2 years ago
- Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search☆1,032Jan 23, 2023Updated 3 years ago
- Self-contained Japanese Morphological Analyzer written in pure Go☆944Updated this week
- Japanese morphological analysis engine written in pure Python☆904Oct 13, 2025Updated 4 months ago
- 🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.☆261Apr 29, 2025Updated 10 months ago
- JavaScript implementation of Japanese morphological analyzer☆966Nov 12, 2023Updated 2 years ago
- Japanese tokenizer for Transformers☆79Dec 15, 2023Updated 2 years ago
- Juman++ (a Morphological Analyzer Toolkit)☆409Oct 3, 2023Updated 2 years ago
- Yet another Japanese morphological analyzer☆1,080Feb 22, 2025Updated last year
- Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)☆199Mar 26, 2024Updated last year
- A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.☆509Oct 24, 2025Updated 4 months ago
- A tool for comparing tokenizers☆121Nov 9, 2025Updated 3 months ago
- A Japanese tokenizer based on recurrent neural networks☆412Feb 12, 2026Updated 2 weeks ago
- 🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer☆251Feb 7, 2026Updated 3 weeks ago
- 🎤 vibrato: Viterbi-based accelerated tokenizer☆398Feb 7, 2026Updated 3 weeks ago
- Go porting of Sudachi☆33Feb 13, 2022Updated 4 years ago
- Japanese text normalizer for mecab-neologd☆286Dec 2, 2025Updated 3 months ago
- A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese☆920Updated this week
- ☆1,591Updated this week
- 自然言語で書かれた時間情報表現を抽出/規格化するルールベースの解析器☆140Feb 27, 2025Updated last year
- A multilingual morphological analysis library.☆605Updated this week
- 📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information☆131Mar 15, 2023Updated 2 years ago
- Emotion analyzer for Japanese text☆116Jul 25, 2024Updated last year
- Kyoto University Web Document Leads Corpus☆83Dec 18, 2023Updated 2 years ago
- Neologism dictionary based on the language resources on the Web for mecab-unidic☆87Sep 14, 2020Updated 5 years ago
- ☆100Jul 23, 2023Updated 2 years ago
- Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku☆341Feb 8, 2026Updated 3 weeks ago
- A Japanese accent dictionary generator☆123Mar 21, 2024Updated last year
- BERT models for Japanese text.☆544Mar 23, 2024Updated last year
- A fast converter between Japanese hankaku and zenkaku characters☆153Jan 12, 2024Updated 2 years ago
- ☆844Updated this week
- A tool for visualizing the internal structures of morphological analyzer Sudachi☆18Jun 9, 2022Updated 3 years ago
- Wikipediaを用いた日本語の固有表現抽出データセット☆142Sep 2, 2023Updated 2 years ago