Alternatives and similar repositories for nlp-datasets

Users that are interested in nlp-datasets are comparing it to the libraries listed below

• gunnxx / indonesian-mt-data
  Benchmarking Multidomain English-Indonesian Machine Translation
  ☆16Updated 4 years ago
• IndoNLP / nusa-writes
  NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented an…
  ☆25Updated 11 months ago
• FerdiantJoshua / question-generator
  An NLP research mainly exploring sequence-to-sequence (s2s) architecture to build Indonesian Automatic Question Generator (AQG). You can …
  ☆24Updated 2 years ago
• shyyhs / CourseraParallelCorpusMining
  Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
  ☆14Updated last year
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 11 months ago
• google-research / xtreme-up
  ☆51Updated 2 years ago
• tatHi / optok
  ☆11Updated 4 years ago
• keyreply / Thai-NLP-Dataset
  More than 43+ collections of Thai Natural Language Processing libraries. Update daily.
  ☆29Updated 7 years ago
• gentaiscool / indonesian-nlp
  A curated list of research papers and resources on Indonesian languages
  ☆39Updated last year
• shisa-ai / shaberi
  Lightblue LLM Eval Framework: tengu, elyza100, ja-mtbench, rakuda
  ☆17Updated 2 weeks ago
• SEACrowd / seacrowd-datahub
  A collaborative project to collect datasets in SEA languages, SEA regions, or SEA cultures.
  ☆85Updated 7 months ago
• allenai / zest
  Code and dataset "ZEST" from "Learning from task descriptions", Weller et al, EMNLP 2020
  ☆17Updated 4 years ago
• acl-org / aclrollingreview
  ACL Rolling Review website
  ☆11Updated this week
• valentinhofmann / flota
  ☆17Updated 2 years ago
• naist-nlp / mbrs
  A library for minimum Bayes risk (MBR) decoding
  ☆45Updated 3 months ago
• neocl / speach
  🐍🍑 Python 3 library for managing, annotating, and converting natural language corpuses using popular formats (CoNLL, ELAN, Praat, CSV, …
  ☆17Updated last year
• fajri91 / sum_liputan6
  The first large-scale summarization corpus for the Indonesian language. AACL 2020.
  ☆39Updated 4 years ago
• matbahasa / TALPCo
  TUFS Asian Language Parallel Corpus
  ☆51Updated 2 years ago
• ltgoslo / ltg-bert
  LTG-Bert
  ☆33Updated last year
• tsuruoka-lab / AMI-Meeting-Parallel-Corpus
  AMI Meeting Parallel Corpus
  ☆11Updated 4 years ago
• laboroai / Laboro-ParaCorpus
  Scripts for creating a Japanese-English parallel corpus and training NMT models
  ☆17Updated 3 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated 2 years ago
• ku-nlp / AnnotatedFKCCorpus
  Annotated Fuman Kaitori Center Corpus
  ☆18Updated last year
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago
• himkt / allennlp-NER
  ☯️ AllenNLP training configurations for promising models on Named Entity Recognition. (BiLSTM-CRF, BiLSTM-CNN-CRF, BERT, BERT-CRF)
  ☆15Updated 4 years ago
• nlp-waseda / comet-atomic-ja
  COMET-ATOMIC ja
  ☆30Updated last year
• kotoba-tech / kotoba-recipes
  Support Continual pre-training & Instruction Tuning forked from llama-recipes
  ☆32Updated last year
• tsuruoka-lab / BSD
  The Business Scene Dialogue corpus
  ☆69Updated 3 years ago
• llm-jp / llm-jp-corpus
  ☆42Updated last year
• ir-nlp-csui / indonli
  IndoNLI
  ☆20Updated 3 years ago