This repository has implementations of data augmentation for NLP for Japanese.
☆64Feb 16, 2023Updated 3 years ago
Alternatives and similar repositories for daaja
Users that are interested in daaja are comparing it to the libraries listed below
Sorting:
- Funer is Rule based Named Entity Recognition tool.☆22Apr 21, 2022Updated 3 years ago
- ☆19May 23, 2024Updated last year
- https://www.nlp.ecei.tohoku.ac.jp/projects/aio/☆16Aug 4, 2022Updated 3 years ago
- An integrated Japanese analyzer based on foundation models☆138Feb 2, 2026Updated last month
- ☆29Apr 10, 2025Updated 10 months ago
- 📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information☆131Mar 15, 2023Updated 2 years ago
- japanese sentence segmentation library for python☆73Apr 3, 2023Updated 2 years ago
- Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)☆199Mar 26, 2024Updated last year
- JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension (2022, Skelter Labs)☆109Mar 2, 2022Updated 4 years ago
- Finding all pairs of similar documents time- and memory-efficiently☆62Mar 13, 2025Updated 11 months ago
- 日本語CLIPモデル☆13Sep 15, 2025Updated 5 months ago
- Awesome List of Sources of Japanese Censored Words☆19Sep 11, 2022Updated 3 years ago
- JGLUE: Japanese General Language Understanding Evaluation☆337Mar 31, 2025Updated 11 months ago
- Wikipediaから作成した日本語名寄せデータセット☆35Mar 10, 2020Updated 5 years ago
- Japanese tokenizer for Transformers☆79Dec 15, 2023Updated 2 years ago
- Use custom tokenizers in spacy-transformers☆16Aug 9, 2022Updated 3 years ago
- Evidence-based Explanation Dataset (AACL-IJCNLP 2020)☆18Dec 17, 2020Updated 5 years ago
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆125Nov 13, 2025Updated 3 months ago
- 🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer☆252Feb 7, 2026Updated last month
- Japanese BERT trained on Aozora Bunko and Wikipedia, pre-tokenized by MeCab with UniDic & SudachiPy☆40Aug 8, 2020Updated 5 years ago
- ☆100Jul 23, 2023Updated 2 years ago
- https://weeklykagglenews.substack.com☆24Dec 31, 2022Updated 3 years ago
- Wikipediaを用いた日本語の固有表現抽出データセット☆142Sep 2, 2023Updated 2 years ago
- ☆31Apr 4, 2018Updated 7 years ago
- Pre-training Language Models for Japanese☆50Jul 2, 2023Updated 2 years ago
- Repository for JSICK☆45May 31, 2023Updated 2 years ago
- ☆174Sep 11, 2025Updated 5 months ago
- albumentations test☆11Jun 23, 2020Updated 5 years ago
- ☆35Dec 17, 2020Updated 5 years ago
- 敬語変換タスクにおける評価用データセット☆21Nov 24, 2022Updated 3 years ago
- install & import するだけで matplotlib を日本語表示対応させる☆201Apr 30, 2024Updated last year
- Trials of pre-trained BERT models for the medical domain in Japanese.☆12Nov 21, 2020Updated 5 years ago
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Jan 12, 2025Updated last year
- The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)☆87Updated this week
- 🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.☆261Updated this week
- Utility scripts for preprocessing Wikipedia texts for NLP☆78Apr 9, 2024Updated last year
- Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)☆77Jun 23, 2023Updated 2 years ago
- 🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.☆21Jun 1, 2025Updated 9 months ago
- Code for COLING 2020 Paper☆13Feb 3, 2026Updated last month