WorksApplications / SudachiPy

Related projects ⓘ

Alternatives and complementary repositories for SudachiPy

• megagonlabs / ginza
  A Japanese NLP Library using spaCy as framework based on Universal Dependencies
  ☆756Updated 7 months ago
• taishi-i / nagisa
  A Japanese tokenizer based on recurrent neural networks
  ☆388Updated 5 months ago
• polm / fugashi
  A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
  ☆402Updated last week
• ikegami-yukino / jaconv
  Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku
  ☆315Updated 3 months ago
• WorksApplications / SudachiDict
  A lexicon for Sudachi
  ☆233Updated 3 weeks ago
• SamuraiT / mecab-python3
  mecab-python. you can find original version here//taku910.github.io/mecab/
  ☆539Updated 2 weeks ago
• ku-nlp / jumanpp
  Juman++ (a Morphological Analyzer Toolkit)
  ☆380Updated last year
• himkt / konoha
  🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
  ☆230Updated 6 months ago
• WorksApplications / Sudachi
  A Japanese Tokenizer for Business
  ☆809Updated this week
• mocobeta / janome
  Japanese morphological analysis engine written in pure Python
  ☆859Updated last year
• WorksApplications / sudachi.rs
  Sudachi in Rust 🦀 and new generation of SudachiPy
  ☆319Updated this week
• ikegami-yukino / neologdn
  Japanese text normalizer for mecab-neologd
  ☆274Updated 6 months ago
• ikegami-yukino / mecab
  This repository is for building Windows 64-bit MeCab binary and improving MeCab Python binding.
  ☆238Updated last month
• WorksApplications / chiVe
  Japanese word embedding with Sudachi and NWJC 🌿
  ☆155Updated 8 months ago
• cl-tohoku / bert-japanese
  BERT models for Japanese text.
  ☆514Updated 7 months ago
• megagonlabs / bunkai
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆186Updated 7 months ago
• taishi-i / toiro
  A comparison tool of Japanese tokenizers
  ☆118Updated 5 months ago
• miurahr / pykakasi
  Lightweight converter from Japanese Kana-kanji sentences into Kana-Roman.
  ☆421Updated 2 years ago
• polm / unidic-py
  Unidic packaged for installation via pip.
  ☆79Updated last year
• tanreinama / gpt2-japanese
  Japanese GPT2 Generation Model
  ☆316Updated last year
• taku910 / mecab
  Yet another Japanese morphological analyzer
  ☆940Updated 4 months ago
• ku-nlp / pyknp
  A Python Module for JUMAN++/KNP
  ☆89Updated 4 months ago
• yoheikikuta / bert-japanese
  BERT with SentencePiece for Japanese text.
  ☆496Updated 3 years ago
• neologd / mecab-unidic-neologd
  Neologism dictionary based on the language resources on the Web for mecab-unidic
  ☆83Updated 4 years ago
• ikegami-yukino / pymlask
  Emotion analyzer for Japanese text
  ☆114Updated 3 months ago
• Kensuke-Mitsuzawa / JapaneseTokenizers
  aim to use JapaneseTokenizer as easy as possible
  ☆138Updated 5 years ago
• taishi-i / awesome-japanese-nlp-resources
  A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese
  ☆700Updated this week
• yahoojapan / JGLUE
  JGLUE: Japanese General Language Understanding Evaluation
  ☆305Updated last month
• himkt / awesome-bert-japanese
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆129Updated last year
• studio-ousia / mojimoji
  A fast converter between Japanese hankaku and zenkaku characters
  ☆144Updated 10 months ago