Alternatives and similar repositories for nlp-datasets

Users that are interested in nlp-datasets are comparing it to the libraries listed below

• gunnxx / indonesian-mt-data
  Benchmarking Multidomain English-Indonesian Machine Translation
  ☆16Updated 5 years ago
• IndoNLP / nusa-writes
  NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented an…
  ☆27Updated last year
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated last month
• gentaiscool / indonesian-nlp
  A curated list of research papers and resources on Indonesian languages
  ☆40Updated last year
• tatHi / optok
  ☆11Updated 4 years ago
• fajri91 / sum_liputan6
  The first large-scale summarization corpus for the Indonesian language. AACL 2020.
  ☆38Updated 4 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago
• tsuruoka-lab / AMI-Meeting-Parallel-Corpus
  AMI Meeting Parallel Corpus
  ☆11Updated 5 years ago
• himkt / allennlp-NER
  ☯️ AllenNLP training configurations for promising models on Named Entity Recognition. (BiLSTM-CRF, BiLSTM-CNN-CRF, BERT, BERT-CRF)
  ☆15Updated 5 years ago
• colorfulscoop / sbert-ja
  Code to train Sentence BERT Japanese model for Hugging Face Model Hub
  ☆11Updated 4 years ago
• FerdiantJoshua / question-generator
  An NLP research mainly exploring sequence-to-sequence (s2s) architecture to build Indonesian Automatic Question Generator (AQG). You can …
  ☆25Updated 3 years ago
• valentinhofmann / flota
  ☆17Updated 3 years ago
• shyyhs / CourseraParallelCorpusMining
  Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
  ☆15Updated last year
• ltgoslo / ltg-bert
  LTG-Bert
  ☆34Updated 2 years ago
• alirezamshi-zz / small100
  Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…
  ☆25Updated 3 years ago
• hppRC / defsent
  DefSent: Sentence Embeddings using Definition Sentences
  ☆22Updated 4 years ago
• chemicaltree / tetra
  ☆10Updated 3 years ago
• explosion / spacy-alignments
  💫 A spaCy package for Yohei Tamura's Rust tokenizations library
  ☆34Updated 7 months ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• yang-zhang / labse-pytorch
  Language-agnostic BERT Sentence Embedding (LaBSE) Pytorch Model
  ☆21Updated 5 years ago
• shisa-ai / shaberi
  Lightblue LLM Eval Framework: tengu, elyza100, ja-mtbench, rakuda
  ☆18Updated 3 weeks ago
• allenai / zest
  Code and dataset "ZEST" from "Learning from task descriptions", Weller et al, EMNLP 2020
  ☆17Updated 4 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆22Updated 2 years ago
• alpoktem / bible2speechDB
  Scripts to create speech corpora from open.bible
  ☆13Updated 4 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆105Updated 3 years ago
• tsuruoka-lab / BSD
  The Business Scene Dialogue corpus
  ☆72Updated 4 years ago
• google-research / xtreme-up
  ☆52Updated 2 years ago
• acl-org / aclrollingreview
  ACL Rolling Review website
  ☆11Updated last week
• ejmejm / multilingual-nmt-mt5
  An example of multilingual machine translation using a pretrained version of mt5 from Hugging Face.
  ☆42Updated 4 years ago
• shijie-wu / neural-transducer
  This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.
  ☆76Updated 2 years ago