Alternatives and similar repositories for japanese-toxic-dataset

Users that are interested in japanese-toxic-dataset are comparing it to the libraries listed below

• megagonlabs / asdc

  View on GitHub
  Accommodation Search Dialog Corpus (宿泊施設探索対話コーパス)
  ☆25Jan 19, 2024Updated 2 years ago
• ku-nlp / JMRD

  View on GitHub
  Japanese Movie Recommendation Dialogue dataset
  ☆28Jul 19, 2022Updated 3 years ago
• aiishii / JEMHopQA

  View on GitHub
  ☆29Apr 10, 2025Updated 10 months ago
• utanaka2000 / fairseq

  View on GitHub
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆25Mar 16, 2021Updated 4 years ago
• masayu-a / WLSP-familiarity

  View on GitHub
  Word Familiarity Rate for 'Word List by Semantic Principles (WLSP)'
  ☆12Jan 2, 2025Updated last year
• colorfulscoop / sbert-ja

  View on GitHub
  Code to train Sentence BERT Japanese model for Hugging Face Model Hub
  ☆11Aug 8, 2021Updated 4 years ago
• singletongue / wikipedia-utils

  View on GitHub
  Utility scripts for preprocessing Wikipedia texts for NLP
  ☆78Apr 9, 2024Updated last year
• DaisukeBekki / JSeM

  View on GitHub
  Japanese semantic test suite (FraCaS counterpart and extensions)
  ☆13Nov 5, 2024Updated last year
• nobu-g / cohesion-analysis

  View on GitHub
  Code for COLING 2020 Paper
  ☆13Feb 3, 2026Updated 2 weeks ago
• tasukuigarashi / j-liwc2015

  View on GitHub
  Japanese version of LIWC2015
  ☆13Nov 6, 2024Updated last year
• ku-nlp / ja-vicuna-qa-benchmark

  View on GitHub
  ☆33Jul 31, 2024Updated last year
• megagonlabs / ebe-dataset

  View on GitHub
  Evidence-based Explanation Dataset (AACL-IJCNLP 2020)
  ☆18Dec 17, 2020Updated 5 years ago
• muhaochen / box_embedding_paper_list

  View on GitHub
  A paper list for box embeddings
  ☆17Jun 9, 2021Updated 4 years ago
• HojiChar / HojiChar

  View on GitHub
  The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.
  ☆125Nov 13, 2025Updated 3 months ago
• verypluming / JaNLI

  View on GitHub
  ☆17May 31, 2023Updated 2 years ago
• yahoojapan / JGLUE

  View on GitHub
  JGLUE: Japanese General Language Understanding Evaluation
  ☆333Mar 31, 2025Updated 10 months ago
• verypluming / JSICK

  View on GitHub
  Repository for JSICK
  ☆45May 31, 2023Updated 2 years ago
• osekilab / JCoLA

  View on GitHub
  ☆19May 23, 2024Updated last year
• cl-tohoku / keigo_transfer_task

  View on GitHub
  敬語変換タスクにおける評価用データセット
  ☆21Nov 24, 2022Updated 3 years ago
• tanreinama / Japanese-Fakenews-Dataset

  View on GitHub
  日本語フェイクニュースデータセット
  ☆20May 2, 2021Updated 4 years ago
• 1never / open2ch-dialogue-corpus

  View on GitHub
  おーぷん2ちゃんねるをクロールして作成した対話コーパス
  ☆98Jun 6, 2021Updated 4 years ago
• Stability-AI / lm-evaluation-harness

  View on GitHub
  A framework for few-shot evaluation of autoregressive language models.
  ☆154Sep 13, 2024Updated last year
• megagonlabs / instruction_ja

  View on GitHub
  Japanese instruction data (日本語指示データ)
  ☆24Jul 13, 2023Updated 2 years ago
• CyberAgentAILab / camera

  View on GitHub
  Multimodal dataset for ad text generation in Japanese [Mita+, ACL2024]
  ☆26Aug 13, 2024Updated last year
• kunishou / do-not-answer-ja

  View on GitHub
  ☆24Dec 15, 2023Updated 2 years ago
• WorksApplications / uzushio

  View on GitHub
  ☆24Jan 27, 2025Updated last year
• ku-nlp / KyotoCorpus

  View on GitHub
  Kyoto University Text Corpus
  ☆68Jul 14, 2023Updated 2 years ago
• kotoba-tech / kotoba-recipes

  View on GitHub
  Support Continual pre-training & Instruction Tuning forked from llama-recipes
  ☆34Feb 17, 2024Updated 2 years ago
• aozorahack / aozorabunko_text

  View on GitHub
  text-only archives of www.aozora.gr.jp
  ☆84Mar 22, 2023Updated 2 years ago
• wwwcojp / ja_sentence_segmenter

  View on GitHub
  japanese sentence segmentation library for python
  ☆73Apr 3, 2023Updated 2 years ago
• hppRC / bert-classification-tutorial-2024

  View on GitHub
  【2024年版】BERTによるテキスト分類
  ☆30Jul 8, 2024Updated last year
• sbintuitions / JMTEB

  View on GitHub
  The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)
  ☆84Jan 6, 2026Updated last month
• Katsumata420 / wikihow_japanese

  View on GitHub
  ☆35Dec 17, 2020Updated 5 years ago
• megagonlabs / jrte-corpus

  View on GitHub
  Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)
  ☆77Jun 23, 2023Updated 2 years ago
• PolyJIT / benchbuild

  View on GitHub
  Empirical-Research Toolkit
  ☆11Nov 21, 2025Updated 2 months ago
• nlp-waseda / JMMLU

  View on GitHub
  日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark
  ☆38Oct 7, 2025Updated 4 months ago
• himkt / allennlp-optuna

  View on GitHub
  ⚡️ AllenNLP plugin for adding subcommands to use Optuna, making hyperparameter optimization easy
  ☆32Nov 23, 2021Updated 4 years ago
• iesl / word2box

  View on GitHub
  Capturing Set-Theoretic Semantics of Words using Box Embeddings
  ☆36Jul 16, 2022Updated 3 years ago
• gohandson / gacha-ja

  View on GitHub
  ガチャをつくろう
  ☆37Aug 19, 2022Updated 3 years ago