himkt / konoha

Related projects ⓘ

Alternatives and complementary repositories for konoha

• polm / fugashi
  A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
  ☆398Updated last week
• WorksApplications / SudachiPy
  Python version of Sudachi, a Japanese tokenizer.
  ☆391Updated 2 years ago
• taishi-i / nagisa
  A Japanese tokenizer based on recurrent neural networks
  ☆386Updated 4 months ago
• taishi-i / toiro
  A comparison tool of Japanese tokenizers
  ☆118Updated 4 months ago
• himkt / awesome-bert-japanese
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆129Updated last year
• Kensuke-Mitsuzawa / JapaneseTokenizers
  aim to use JapaneseTokenizer as easy as possible
  ☆138Updated 5 years ago
• megagonlabs / bunkai
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆186Updated 7 months ago
• polm / unidic-py
  Unidic packaged for installation via pip.
  ☆77Updated last year
• buruzaemon / natto-py
  natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.
  ☆92Updated 5 months ago
• ku-nlp / jumanpp
  Juman++ (a Morphological Analyzer Toolkit)
  ☆379Updated last year
• ikegami-yukino / jaconv
  Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku
  ☆314Updated 2 months ago
• WorksApplications / sudachi.rs
  Sudachi in Rust 🦀 and new generation of SudachiPy
  ☆318Updated this week
• polm / unidic-lite
  A small version of UniDic for easy pip installs.
  ☆38Updated 4 years ago
• WorksApplications / SudachiDict
  A lexicon for Sudachi
  ☆232Updated 2 weeks ago
• ku-nlp / kwja
  An integrated Japanese analyzer based on foundation models
  ☆129Updated last month
• SamuraiT / mecab-python3
  mecab-python. you can find original version here//taku910.github.io/mecab/
  ☆539Updated last week
• megagonlabs / ginza
  A Japanese NLP Library using spaCy as framework based on Universal Dependencies
  ☆755Updated 7 months ago
• ku-nlp / pyknp
  A Python Module for JUMAN++/KNP
  ☆89Updated 4 months ago
• neologd / mecab-unidic-neologd
  Neologism dictionary based on the language resources on the Web for mecab-unidic
  ☆82Updated 4 years ago
• cl-tohoku / bert-japanese
  BERT models for Japanese text.
  ☆514Updated 7 months ago
• ikegami-yukino / pymlask
  Emotion analyzer for Japanese text
  ☆114Updated 3 months ago
• yoheikikuta / bert-japanese
  BERT with SentencePiece for Japanese text.
  ☆497Updated 3 years ago
• stockmarkteam / ner-wikipedia-dataset
  Wikipediaを用いた日本語の固有表現抽出データセット
  ☆132Updated last year
• daac-tools / vaporetto
  🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
  ☆229Updated this week
• WorksApplications / chiVe
  Japanese word embedding with Sudachi and NWJC 🌿
  ☆155Updated 8 months ago
• WorksApplications / SudachiTra
  Japanese tokenizer for Transformers
  ☆78Updated 10 months ago
• ikegami-yukino / neologdn
  Japanese text normalizer for mecab-neologd
  ☆273Updated 6 months ago
• tmu-nlp / JapaneseWordSimilarityDataset
  Japanese Word Similarity Dataset
  ☆100Updated 2 years ago
• yahoojapan / JGLUE
  JGLUE: Japanese General Language Understanding Evaluation
  ☆305Updated last month
• taishi-i / awesome-japanese-nlp-resources
  A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese
  ☆696Updated this week