WorksApplications / sudachi.rs

Related projects ⓘ

Alternatives and complementary repositories for sudachi.rs

• daac-tools / vibrato
  🎤 vibrato: Viterbi-based accelerated tokenizer
  ☆333Updated last month
• WorksApplications / SudachiDict
  A lexicon for Sudachi
  ☆232Updated 2 weeks ago
• WorksApplications / SudachiPy
  Python version of Sudachi, a Japanese tokenizer.
  ☆391Updated 2 years ago
• daac-tools / vaporetto
  🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
  ☆229Updated this week
• megagonlabs / bunkai
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆186Updated 7 months ago
• ku-nlp / jumanpp
  Juman++ (a Morphological Analyzer Toolkit)
  ☆379Updated last year
• taishi-i / toiro
  A comparison tool of Japanese tokenizers
  ☆118Updated 4 months ago
• taishi-i / nagisa
  A Japanese tokenizer based on recurrent neural networks
  ☆386Updated 4 months ago
• himkt / konoha
  🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
  ☆230Updated 5 months ago
• neologd / mecab-unidic-neologd
  Neologism dictionary based on the language resources on the Web for mecab-unidic
  ☆82Updated 4 years ago
• lindera / lindera
  A multilingual morphological analysis library.
  ☆385Updated this week
• ikegami-yukino / jaconv
  Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku
  ☆314Updated 2 months ago
• megagonlabs / ginza
  A Japanese NLP Library using spaCy as framework based on Universal Dependencies
  ☆755Updated 7 months ago
• ku-nlp / pyknp
  A Python Module for JUMAN++/KNP
  ☆89Updated 4 months ago
• WorksApplications / chiVe
  Japanese word embedding with Sudachi and NWJC 🌿
  ☆155Updated 8 months ago
• polm / unidic-py
  Unidic packaged for installation via pip.
  ☆77Updated last year
• polm / fugashi
  A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
  ☆398Updated last week
• WorksApplications / Sudachi
  A Japanese Tokenizer for Business
  ☆806Updated this week
• ikegami-yukino / neologdn
  Japanese text normalizer for mecab-neologd
  ☆273Updated 6 months ago
• ikegami-yukino / mecab
  This repository is for building Windows 64-bit MeCab binary and improving MeCab Python binding.
  ☆238Updated 3 weeks ago
• studio-ousia / mojimoji
  A fast converter between Japanese hankaku and zenkaku characters
  ☆144Updated 9 months ago
• ku-nlp / kwja
  An integrated Japanese analyzer based on foundation models
  ☆129Updated last month
• kujirahand / EJDict
  English-Japanese Dictionary data (Public Domain) EJDict-hand
  ☆194Updated 8 months ago
• mocobeta / janome
  Japanese morphological analysis engine written in pure Python
  ☆856Updated last year
• WorksApplications / elasticsearch-sudachi
  The Japanese analysis plugin for elasticsearch
  ☆183Updated this week
• taishi-i / awesome-japanese-nlp-resources
  A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese
  ☆696Updated this week
• ikegami-yukino / pymlask
  Emotion analyzer for Japanese text
  ☆114Updated 3 months ago
• himkt / awesome-bert-japanese
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆129Updated last year
• ndl-lab / ndlocr_cli
  NDLOCRアプリケーションのリポジトリ（ソースコードを含む）
  ☆352Updated this week
• ikawaha / kagome
  Self-contained Japanese Morphological Analyzer written in pure Go
  ☆825Updated 2 weeks ago