Alternatives and similar repositories for UD_Japanese-GSD

Users that are interested in UD_Japanese-GSD are comparing it to the libraries listed below

• megagonlabs / jrte-corpus

  View on GitHub
  Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)
  ☆77Jun 23, 2023Updated 2 years ago
• singletongue / wikipedia-utils

  View on GitHub
  Utility scripts for preprocessing Wikipedia texts for NLP
  ☆78Apr 9, 2024Updated last year
• WorksApplications / SudachiTra

  View on GitHub
  Japanese tokenizer for Transformers
  ☆79Dec 15, 2023Updated 2 years ago
• himkt / awesome-bert-japanese

  View on GitHub
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆131Mar 15, 2023Updated 2 years ago
• ou-medinfo / medbertjp

  View on GitHub
  Trials of pre-trained BERT models for the medical domain in Japanese.
  ☆12Nov 21, 2020Updated 5 years ago
• stockmarkteam / ner-wikipedia-dataset

  View on GitHub
  Wikipediaを用いた日本語の固有表現抽出データセット
  ☆142Sep 2, 2023Updated 2 years ago
• junya-takayama / DIRECT

  View on GitHub
  DIRECT: Direct and Indirect REsponses in Conversational Text Corpus
  ☆17Jul 1, 2021Updated 4 years ago
• shimo-lab / sembei

  View on GitHub
  単語分割を経由しない単語埋め込み
  ☆14Mar 19, 2017Updated 8 years ago
• aiishii / JEMHopQA

  View on GitHub
  ☆29Apr 10, 2025Updated 10 months ago
• taishi-i / toiro

  View on GitHub
  A tool for comparing tokenizers
  ☆120Nov 9, 2025Updated 3 months ago
• KodairaTomonori / ThreeLineSummaryDataset

  View on GitHub
  ☆31Apr 4, 2018Updated 7 years ago
• chakki-works / Japanese-Company-Lexicon

  View on GitHub
  ☆100Jul 23, 2023Updated 2 years ago
• megagonlabs / ebe-dataset

  View on GitHub
  Evidence-based Explanation Dataset (AACL-IJCNLP 2020)
  ☆18Dec 17, 2020Updated 5 years ago
• yagays / nayose-wikipedia-ja

  View on GitHub
  Wikipediaから作成した日本語名寄せデータセット
  ☆35Mar 10, 2020Updated 5 years ago
• UniversalDependencies / UD_Japanese-GSD

  View on GitHub
  Japanese data from the Google UDT 2.0.
  ☆38Nov 12, 2025Updated 3 months ago
• cl-tohoku / keigo_transfer_task

  View on GitHub
  敬語変換タスクにおける評価用データセット
  ☆21Nov 24, 2022Updated 3 years ago
• chemicaltree / tetra

  View on GitHub
  ☆10Sep 14, 2022Updated 3 years ago
• masayu-a / NAIST-JENE

  View on GitHub
  ☆10Aug 13, 2012Updated 13 years ago
• informatix-inc / bert

  View on GitHub
  ☆28Apr 5, 2022Updated 3 years ago
• UniversalDependencies / UD_Japanese-BCCWJ

  View on GitHub
  ☆27Nov 12, 2025Updated 3 months ago
• daac-tools / python-vaporetto

  View on GitHub
  🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
  ☆21Jun 1, 2025Updated 8 months ago
• wwwcojp / ja_sentence_segmenter

  View on GitHub
  japanese sentence segmentation library for python
  ☆73Apr 3, 2023Updated 2 years ago
• ujiuji1259 / shinra-attribute-extraction

  View on GitHub
  ☆11Sep 7, 2021Updated 4 years ago
• ikegami-yukino / sengiri

  View on GitHub
  Yet another sentence-level tokenizer for the Japanese text
  ☆24Nov 27, 2025Updated 2 months ago
• yahoojapan / VFD-Dataset

  View on GitHub
  ☆11Nov 10, 2020Updated 5 years ago
• shiroyagicorp / sitq

  View on GitHub
  Learning to Hash for Maximum Inner Product Search
  ☆12Jan 21, 2022Updated 4 years ago
• shunk031 / huggingface-datasets_JGLUE

  View on GitHub
  JGLUE: Japanese General Language Understanding Evaluation for huggingface datasets
  ☆12Mar 31, 2025Updated 10 months ago
• ku-nlp / WikipediaAnnotatedCorpus

  View on GitHub
  ☆11Feb 1, 2026Updated 2 weeks ago
• kenkov / cabocha

  View on GitHub
  CaboCha wrapper for Python3
  ☆46Jul 5, 2018Updated 7 years ago
• BandaiNamcoResearchInc / DistilBERT-base-jp

  View on GitHub
  ☆161Oct 19, 2020Updated 5 years ago
• azu / sudachi-synonyms-dictionary

  View on GitHub
  Sudachi's synonyms dictionary
  ☆13Jan 25, 2026Updated 3 weeks ago
• mokejp / holidays_jp

  View on GitHub
  日本の祝日 祝祭日 を計算するPythonライブラリ
  ☆15Jul 25, 2022Updated 3 years ago
• nobu-g / cohesion-analysis

  View on GitHub
  Code for COLING 2020 Paper
  ☆13Feb 3, 2026Updated last week
• WorksApplications / chiVe

  View on GitHub
  Japanese word embedding with Sudachi and NWJC 🌿
  ☆169Mar 1, 2024Updated last year
• ku-nlp / KWDLC

  View on GitHub
  Kyoto University Web Document Leads Corpus
  ☆83Dec 18, 2023Updated 2 years ago
• p-geon / DropoutCheatSheet

  View on GitHub
  ☆33Apr 27, 2020Updated 5 years ago
• Katsumata420 / wikihow_japanese

  View on GitHub
  ☆35Dec 17, 2020Updated 5 years ago
• alinear-corp / albert-japanese

  View on GitHub
  BERT with SentencePiece for Japanese text.
  ☆33Oct 28, 2021Updated 4 years ago
• ku-nlp / kwja

  View on GitHub
  An integrated Japanese analyzer based on foundation models
  ☆138Feb 2, 2026Updated 2 weeks ago