taishi-i / awesome-japanese-nlp-resources

Related projects ⓘ

Alternatives and complementary repositories for awesome-japanese-nlp-resources

• taishi-i / nagisa
  A Japanese tokenizer based on recurrent neural networks
  ☆386Updated 4 months ago
• WorksApplications / SudachiPy
  Python version of Sudachi, a Japanese tokenizer.
  ☆391Updated 2 years ago
• polm / fugashi
  A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
  ☆398Updated last week
• megagonlabs / ginza
  A Japanese NLP Library using spaCy as framework based on Universal Dependencies
  ☆755Updated 7 months ago
• ku-nlp / jumanpp
  Juman++ (a Morphological Analyzer Toolkit)
  ☆379Updated last year
• himkt / konoha
  🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
  ☆230Updated 5 months ago
• yahoojapan / JGLUE
  JGLUE: Japanese General Language Understanding Evaluation
  ☆305Updated last month
• llm-jp / awesome-japanese-llm
  日本語LLMまとめ - Overview of Japanese LLMs
  ☆1,009Updated last week
• WorksApplications / sudachi.rs
  Sudachi in Rust 🦀 and new generation of SudachiPy
  ☆318Updated this week
• WorksApplications / Sudachi
  A Japanese Tokenizer for Business
  ☆806Updated this week
• mocobeta / janome
  Japanese morphological analysis engine written in pure Python
  ☆856Updated last year
• SamuraiT / mecab-python3
  mecab-python. you can find original version here//taku910.github.io/mecab/
  ☆539Updated last week
• cl-tohoku / bert-japanese
  BERT models for Japanese text.
  ☆514Updated 7 months ago
• ikegami-yukino / jaconv
  Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku
  ☆314Updated 2 months ago
• ikegami-yukino / mecab
  This repository is for building Windows 64-bit MeCab binary and improving MeCab Python binding.
  ☆238Updated 3 weeks ago
• tanreinama / gpt2-japanese
  Japanese GPT2 Generation Model
  ☆316Updated last year
• rinnakk / japanese-pretrained-models
  Code for producing Japanese pretrained models provided by rinna Co., Ltd.
  ☆578Updated 2 years ago
• polm / unidic-py
  Unidic packaged for installation via pip.
  ☆77Updated last year
• WorksApplications / SudachiDict
  A lexicon for Sudachi
  ☆232Updated 2 weeks ago
• ikegami-yukino / neologdn
  Japanese text normalizer for mecab-neologd
  ☆273Updated 6 months ago
• tanreinama / OCR_Japanease
  日本語OCR
  ☆226Updated 3 years ago
• ku-nlp / kwja
  An integrated Japanese analyzer based on foundation models
  ☆129Updated last month
• WorksApplications / chiVe
  Japanese word embedding with Sudachi and NWJC 🌿
  ☆155Updated 8 months ago
• miurahr / pykakasi
  Lightweight converter from Japanese Kana-kanji sentences into Kana-Roman.
  ☆421Updated 2 years ago
• megagonlabs / bunkai
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆186Updated 7 months ago
• hppRC / bert-classification-tutorial
  【2023年版】BERTによるテキスト分類
  ☆226Updated 5 months ago
• takuyaa / kuromoji.js
  JavaScript implementation of Japanese morphological analyzer
  ☆858Updated 11 months ago
• nttcslab / japanese-dialog-transformers
  Code for evaluating Japanese pretrained models provided by NTT Ltd.
  ☆240Updated last year
• himkt / awesome-bert-japanese
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆129Updated last year
• taishi-i / toiro
  A comparison tool of Japanese tokenizers
  ☆118Updated 4 months ago