Alternatives and similar repositories for ja_sentence_segmenter

Users that are interested in ja_sentence_segmenter are comparing it to the libraries listed below

• yagays / nayose-wikipedia-ja

  View on GitHub
  Wikipediaから作成した日本語名寄せデータセット
  ☆35Mar 10, 2020Updated 5 years ago
• izuna385 / Wikia-and-Wikipedia-EL-Dataset-Creator

  View on GitHub
  You can create datasets from Wikia/Wikipedia that can be used for entity recognition and Entity Linking. Dumps for ja-wiki and VTuber-wik…
  ☆17May 2, 2021Updated 4 years ago
• stockmarkteam / ner-wikipedia-dataset

  View on GitHub
  Wikipediaを用いた日本語の固有表現抽出データセット
  ☆142Sep 2, 2023Updated 2 years ago
• megagonlabs / bunkai

  View on GitHub
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆199Mar 26, 2024Updated last year
• himkt / awesome-bert-japanese

  View on GitHub
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆131Mar 15, 2023Updated 2 years ago
• kajyuuen / daaja

  View on GitHub
  This repository has implementations of data augmentation for NLP for Japanese.
  ☆64Feb 16, 2023Updated 2 years ago
• verypluming / JaNLI

  View on GitHub
  ☆17May 31, 2023Updated 2 years ago
• chakki-works / Japanese-Company-Lexicon

  View on GitHub
  ☆100Jul 23, 2023Updated 2 years ago
• aiishii / JEMHopQA

  View on GitHub
  ☆29Apr 10, 2025Updated 10 months ago
• osekilab / JCoLA

  View on GitHub
  ☆19May 23, 2024Updated last year
• vaaaaanquish / docker-UTH-BERT

  View on GitHub
  docker for UTH-BERT: https://ai-health.m.u-tokyo.ac.jp/uth-bert
  ☆14Mar 24, 2023Updated 2 years ago
• retarfi / language-pretraining

  View on GitHub
  Pre-training Language Models for Japanese
  ☆50Jul 2, 2023Updated 2 years ago
• singletongue / wikipedia-utils

  View on GitHub
  Utility scripts for preprocessing Wikipedia texts for NLP
  ☆78Apr 9, 2024Updated last year
• megagonlabs / jrte-corpus

  View on GitHub
  Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)
  ☆77Jun 23, 2023Updated 2 years ago
• ku-nlp / kwja

  View on GitHub
  An integrated Japanese analyzer based on foundation models
  ☆138Feb 2, 2026Updated last week
• HojiChar / HojiChar

  View on GitHub
  The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.
  ☆124Nov 13, 2025Updated 3 months ago
• kzinmr / transformers_ner_ja

  View on GitHub
  Japanese NER with Transformers + PyTorch-Lightning + MLflow Tracking
  ☆15Nov 20, 2022Updated 3 years ago
• conditional / jawikify

  View on GitHub
  日本語テキストに対する wikification のためのソフトウェア
  ☆17Mar 14, 2017Updated 8 years ago
• ikegami-yukino / neologdn

  View on GitHub
  Japanese text normalizer for mecab-neologd
  ☆286Dec 2, 2025Updated 2 months ago
• cl-tohoku / JAQKET_baseline

  View on GitHub
  ☆16Oct 11, 2021Updated 4 years ago
• megagonlabs / UD_Japanese-GSD

  View on GitHub
  Japanese data from the Google UDT 2.0.
  ☆28Mar 24, 2023Updated 2 years ago
• BandaiNamcoResearchInc / DistilBERT-base-jp

  View on GitHub
  ☆161Oct 19, 2020Updated 5 years ago
• aistairc / trf

  View on GitHub
  This is the repository for TRF (text readability features) publication.
  ☆37Aug 27, 2019Updated 6 years ago
• WorksApplications / SudachiPy

  View on GitHub
  Python version of Sudachi, a Japanese tokenizer.
  ☆425Oct 7, 2022Updated 3 years ago
• azooKey / AJIMEE-Bench

  View on GitHub
  AJIMEE-Bench (Advanced Japanese IME Evaluation Benchmark)
  ☆18Jan 13, 2025Updated last year
• colorfulscoop / sbert-ja

  View on GitHub
  Code to train Sentence BERT Japanese model for Hugging Face Model Hub
  ☆11Aug 8, 2021Updated 4 years ago
• chemicaltree / tetra

  View on GitHub
  ☆10Sep 14, 2022Updated 3 years ago
• youichiro / transformer-copy

  View on GitHub
  日本語文法誤り訂正ツール
  ☆29Jun 22, 2022Updated 3 years ago
• sociocom / MedNER-J

  View on GitHub
  Latest version of MedEX/J (Japanese disease name extractor)
  ☆18May 17, 2022Updated 3 years ago
• WorksApplications / SudachiTra

  View on GitHub
  Japanese tokenizer for Transformers
  ☆79Dec 15, 2023Updated 2 years ago
• verypluming / JSICK

  View on GitHub
  Repository for JSICK
  ☆45May 31, 2023Updated 2 years ago
• Hironsan / ja.text8

  View on GitHub
  Japanese text8 corpus for word embedding.
  ☆111Oct 4, 2017Updated 8 years ago
• intellygenta / InteractiveParallelCoordinates

  View on GitHub
  Python code for interactive parallel coordinates visualization on jupyter notebook.
  ☆11Sep 8, 2019Updated 6 years ago
• ujiuji1259 / shinra-attribute-extraction

  View on GitHub
  ☆11Sep 7, 2021Updated 4 years ago
• ikegami-yukino / asa-python

  View on GitHub
  Japanese Argument Structure Analyzer (ASA) client for Python
  ☆11Feb 16, 2019Updated 6 years ago
• Katsumata420 / wikihow_japanese

  View on GitHub
  ☆35Dec 17, 2020Updated 5 years ago
• cl-tohoku / keigo_transfer_task

  View on GitHub
  敬語変換タスクにおける評価用データセット
  ☆21Nov 24, 2022Updated 3 years ago
• SkelterLabsInc / JaQuAD

  View on GitHub
  JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension (2022, Skelter Labs)
  ☆108Mar 2, 2022Updated 3 years ago
• lighttransport / japanese-llama-experiment

  View on GitHub
  Japanese LLaMa experiment
  ☆54Dec 27, 2025Updated last month