Alternatives and similar repositories for gpt2-japanese

Users that are interested in gpt2-japanese are comparing it to the libraries listed below

• tanreinama / text2text-japanese

  View on GitHub
  gpt-2 based text2text conversion model
  ☆33Jul 22, 2021Updated 4 years ago
• tanreinama / Japanese-BPEEncoder

  View on GitHub
  Japanese-BPEEncoder
  ☆41Sep 12, 2021Updated 4 years ago
• tanreinama / GPTSAN

  View on GitHub
  General-purpose Swich transformer based Japanese language model
  ☆118Sep 13, 2023Updated 2 years ago
• nttcslab / japanese-dialog-transformers

  View on GitHub
  Code for evaluating Japanese pretrained models provided by NTT Ltd.
  ☆245Jun 21, 2023Updated 2 years ago
• wwwcojp / ja_sentence_segmenter

  View on GitHub
  japanese sentence segmentation library for python
  ☆73Apr 3, 2023Updated 2 years ago
• Katsumata420 / wikihow_japanese

  View on GitHub
  ☆35Dec 17, 2020Updated 5 years ago
• akirakubo / bert-japanese-aozora

  View on GitHub
  Japanese BERT trained on Aozora Bunko and Wikipedia, pre-tokenized by MeCab with UniDic & SudachiPy
  ☆40Aug 8, 2020Updated 5 years ago
• sonoisa / t5-japanese

  View on GitHub
  日本語T5モデル
  ☆116Sep 15, 2025Updated 5 months ago
• utanaka2000 / fairseq

  View on GitHub
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆25Mar 16, 2021Updated 4 years ago
• cl-tohoku / bert-japanese

  View on GitHub
  BERT models for Japanese text.
  ☆544Mar 23, 2024Updated last year
• himkt / awesome-bert-japanese

  View on GitHub
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆131Mar 15, 2023Updated 2 years ago
• ku-nlp / AnnotatedFKCCorpus

  View on GitHub
  Annotated Fuman Kaitori Center Corpus
  ☆18Dec 18, 2023Updated 2 years ago
• discus0434 / text-generation

  View on GitHub
  Easy-to-use scripts to fine-tune GPT-2-JA with your own texts, to generate sentences, and to tweet them automatically.
  ☆19Aug 26, 2025Updated 5 months ago
• megagonlabs / bunkai

  View on GitHub
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆199Mar 26, 2024Updated last year
• ids-cv / wrime

  View on GitHub
  ☆174Sep 11, 2025Updated 5 months ago
• megagonlabs / jrte-corpus

  View on GitHub
  Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)
  ☆77Jun 23, 2023Updated 2 years ago
• hppRC / bert-classification-tutorial

  View on GitHub
  【2023年版】BERTによるテキスト分類
  ☆235May 28, 2024Updated last year
• yoheikikuta / bert-japanese

  View on GitHub
  BERT with SentencePiece for Japanese text.
  ☆498Feb 15, 2021Updated 5 years ago
• SkelterLabsInc / JaQuAD

  View on GitHub
  JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension (2022, Skelter Labs)
  ☆108Mar 2, 2022Updated 3 years ago
• 1never / open2ch-dialogue-corpus

  View on GitHub
  おーぷん2ちゃんねるをクロールして作成した対話コーパス
  ☆98Jun 6, 2021Updated 4 years ago
• kajyuuen / daaja

  View on GitHub
  This repository has implementations of data augmentation for NLP for Japanese.
  ☆64Feb 16, 2023Updated 3 years ago
• arXivTimes / arXivTimes

  View on GitHub
  repository to research & share the machine learning articles
  ☆3,905Jul 1, 2022Updated 3 years ago
• Yukaryavka / rinna_gpt-neox_ggml-lora

  View on GitHub
  The repository contains scripts and merge scripts that have been modified to adapt an Alpaca-Lora adapter for LoRA tuning when assuming t…
  ☆18May 24, 2023Updated 2 years ago
• verypluming / JaNLI

  View on GitHub
  ☆17May 31, 2023Updated 2 years ago
• cl-tohoku / ILYS-aoba-chatbot

  View on GitHub
  ☆23Oct 1, 2021Updated 4 years ago
• npaka3 / akane-talk

  View on GitHub
  ☆26May 16, 2021Updated 4 years ago
• nobu-g / cohesion-analysis

  View on GitHub
  Code for COLING 2020 Paper
  ☆13Feb 3, 2026Updated 2 weeks ago
• verypluming / JSICK

  View on GitHub
  Repository for JSICK
  ☆45May 31, 2023Updated 2 years ago
• tanreinama / OCR_Japanease

  View on GitHub
  日本語OCR
  ☆244Aug 7, 2021Updated 4 years ago
• kunishou / Japanese-Alpaca-LoRA

  View on GitHub
  ☆141Apr 2, 2023Updated 2 years ago
• aws-samples / bokete-denshosen

  View on GitHub
  ボケて電笑戦 (bokete DENSHOSEN) Workshop
  ☆43May 16, 2022Updated 3 years ago
• KodairaTomonori / ThreeLineSummaryDataset

  View on GitHub
  ☆31Apr 4, 2018Updated 7 years ago
• tanreinama / aMLP-japanese

  View on GitHub
  aMLP Transformer Model for Japanese
  ☆16May 10, 2022Updated 3 years ago
• yahoojapan / JGLUE

  View on GitHub
  JGLUE: Japanese General Language Understanding Evaluation
  ☆333Mar 31, 2025Updated 10 months ago
• BandaiNamcoResearchInc / DistilBERT-base-jp

  View on GitHub
  ☆161Oct 19, 2020Updated 5 years ago
• megagonlabs / asdc

  View on GitHub
  Accommodation Search Dialog Corpus (宿泊施設探索対話コーパス)
  ☆25Jan 19, 2024Updated 2 years ago
• tanreinama / Japanese-Fakenews-Dataset

  View on GitHub
  日本語フェイクニュースデータセット
  ☆20May 2, 2021Updated 4 years ago
• octanove / shiba

  View on GitHub
  Pytorch implementation and pre-trained Japanese model for CANINE, the efficient character-level transformer.
  ☆89Nov 3, 2023Updated 2 years ago
• MosasoM / inappropriate-words-ja

  View on GitHub
  日本語における不適切表現を収集します。自然言語処理の時のデータクリーニング用等に使えると思います。
  ☆201Dec 1, 2021Updated 4 years ago