Alternatives and similar repositories for ner-wikipedia-dataset

Users that are interested in ner-wikipedia-dataset are comparing it to the libraries listed below

• yahoojapan / JGLUE

  View on GitHub
  JGLUE: Japanese General Language Understanding Evaluation
  ☆333Mar 31, 2025Updated 10 months ago
• megagonlabs / UD_Japanese-GSD

  View on GitHub
  Japanese data from the Google UDT 2.0.
  ☆28Mar 24, 2023Updated 2 years ago
• WorksApplications / SudachiTra

  View on GitHub
  Japanese tokenizer for Transformers
  ☆79Dec 15, 2023Updated 2 years ago
• wwwcojp / ja_sentence_segmenter

  View on GitHub
  japanese sentence segmentation library for python
  ☆73Apr 3, 2023Updated 2 years ago
• WorksApplications / chikkarpy

  View on GitHub
  Japanese synonym library
  ☆55Feb 7, 2022Updated 4 years ago
• megagonlabs / jrte-corpus

  View on GitHub
  Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)
  ☆77Jun 23, 2023Updated 2 years ago
• kajyuuen / funer

  View on GitHub
  Funer is Rule based Named Entity Recognition tool.
  ☆22Apr 21, 2022Updated 3 years ago
• Hironsan / IOB2Corpus

  View on GitHub
  Japanese IOB2 tagged corpus for Named Entity Recognition.
  ☆61Feb 25, 2020Updated 5 years ago
• WorksApplications / chiVe

  View on GitHub
  Japanese word embedding with Sudachi and NWJC 🌿
  ☆169Mar 1, 2024Updated last year
• ken11 / bert-japanese-ner-finetuning

  View on GitHub
  ☆11Jun 19, 2022Updated 3 years ago
• aiishii / JEMHopQA

  View on GitHub
  ☆29Apr 10, 2025Updated 10 months ago
• cl-tohoku / JAQKET_baseline

  View on GitHub
  ☆16Oct 11, 2021Updated 4 years ago
• himkt / awesome-bert-japanese

  View on GitHub
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆131Mar 15, 2023Updated 2 years ago
• SkelterLabsInc / JaQuAD

  View on GitHub
  JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension (2022, Skelter Labs)
  ☆108Mar 2, 2022Updated 3 years ago
• kajyuuen / daaja

  View on GitHub
  This repository has implementations of data augmentation for NLP for Japanese.
  ☆64Feb 16, 2023Updated 2 years ago
• WorksApplications / uzushio

  View on GitHub
  ☆24Jan 27, 2025Updated last year
• lighttransport / jagger-python

  View on GitHub
  Python binding for Jagger(C++ implementation of Pattern-based Japanese Morphological Analyzer)
  ☆12Dec 16, 2025Updated last month
• chakki-works / Japanese-Company-Lexicon

  View on GitHub
  ☆100Jul 23, 2023Updated 2 years ago
• sociocom / MedNER-J

  View on GitHub
  Latest version of MedEX/J (Japanese disease name extractor)
  ☆18May 17, 2022Updated 3 years ago
• 1never / open2ch-dialogue-corpus

  View on GitHub
  おーぷん2ちゃんねるをクロールして作成した対話コーパス
  ☆98Jun 6, 2021Updated 4 years ago
• HojiChar / HojiChar

  View on GitHub
  The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.
  ☆124Nov 13, 2025Updated 3 months ago
• cl-tohoku / AIO2_DPR_baseline

  View on GitHub
  https://www.nlp.ecei.tohoku.ac.jp/projects/aio/
  ☆16Aug 4, 2022Updated 3 years ago
• daac-tools / vaporetto

  View on GitHub
  🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
  ☆251Feb 7, 2026Updated last week
• singletongue / wikipedia-utils

  View on GitHub
  Utility scripts for preprocessing Wikipedia texts for NLP
  ☆78Apr 9, 2024Updated last year
• cl-tohoku / bert-japanese

  View on GitHub
  BERT models for Japanese text.
  ☆543Mar 23, 2024Updated last year
• chakki-works / chABSA-dataset

  View on GitHub
  chakki's Aspect-Based Sentiment Analysis dataset
  ☆141Feb 25, 2022Updated 3 years ago
• ku-nlp / kwja

  View on GitHub
  An integrated Japanese analyzer based on foundation models
  ☆138Feb 2, 2026Updated last week
• oshizo / JapaneseEmbeddingEval

  View on GitHub
  ☆183Oct 9, 2024Updated last year
• megagonlabs / bunkai

  View on GitHub
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆199Mar 26, 2024Updated last year
• retarfi / language-pretraining

  View on GitHub
  Pre-training Language Models for Japanese
  ☆50Jul 2, 2023Updated 2 years ago
• yagays / nayose-wikipedia-ja

  View on GitHub
  Wikipediaから作成した日本語名寄せデータセット
  ☆35Mar 10, 2020Updated 5 years ago
• ku-nlp / KWDLC

  View on GitHub
  Kyoto University Web Document Leads Corpus
  ☆83Dec 18, 2023Updated 2 years ago
• ymym3412 / acl-papers

  View on GitHub
  paper summary of Association for Computational Linguistics
  ☆185Sep 16, 2019Updated 6 years ago
• verypluming / JaNLI

  View on GitHub
  ☆17May 31, 2023Updated 2 years ago
• sonoisa / t5-japanese

  View on GitHub
  日本語T5モデル
  ☆116Sep 15, 2025Updated 5 months ago
• ids-cv / wrime

  View on GitHub
  ☆174Sep 11, 2025Updated 5 months ago
• megagonlabs / ginza

  View on GitHub
  A Japanese NLP Library using spaCy as framework based on Universal Dependencies
  ☆833Mar 30, 2024Updated last year
• ikegami-yukino / neologdn

  View on GitHub
  Japanese text normalizer for mecab-neologd
  ☆286Dec 2, 2025Updated 2 months ago
• megagonlabs / t5-japanese

  View on GitHub
  Codes to pre-train Japanese T5 models
  ☆40Sep 7, 2021Updated 4 years ago