Alternatives and similar repositories for bookcorpus

Users that are interested in bookcorpus are comparing it to the libraries listed below

• jcpeterson / openwebtext
  Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.
  ☆751Updated 3 years ago
• uber-research / PPLM
  Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
  ☆1,153Updated last year
• yet-another-account / openwebtext
  An open clone of the GPT-2 WebText dataset by OpenAI. Still WIP.
  ☆392Updated last year
• nyu-mll / jiant
  jiant is an nlp toolkit
  ☆1,674Updated 2 years ago
• nikitakit / self-attentive-parser
  High-accuracy NLP parser with models for 11 languages.
  ☆903Updated 4 years ago
• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆782Updated 2 years ago
• golsun / DialogRPT
  EMNLP 2020: "Dialogue Response Ranking Training with Large-Scale Human Feedback Data"
  ☆345Updated last year
• glample / fastBPE
  Fast BPE
  ☆678Updated last year
• alexa / Topical-Chat
  A dataset containing human-human knowledge-grounded open-domain conversations.
  ☆670Updated last year
• google-research-datasets / paws
  This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, an…
  ☆561Updated 4 years ago
• timoschick / pet
  This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"
  ☆1,628Updated 2 years ago
• google-research / xtreme
  XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 ty…
  ☆650Updated 3 years ago
• facebookresearch / ELI5
  Scripts and links to recreate the ELI5 dataset.
  ☆326Updated 4 years ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,039Updated 2 years ago
• facebookresearch / anli
  Adversarial Natural Language Inference Benchmark
  ☆397Updated 3 years ago
• rowanz / grover
  Code for Defending Against Neural Fake News, https://rowanzellers.com/grover/
  ☆919Updated 2 years ago
• allenai / allennlp-models
  Officially supported AllenNLP models
  ☆556Updated 3 years ago
• facebookresearch / XNLI
  Evaluating Cross-lingual Sentence Representations
  ☆462Updated 4 years ago
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆433Updated 3 years ago
• EleutherAI / the-pile
  ☆1,630Updated 2 years ago
• neulab / compare-mt
  A tool for holistic analysis of language generations systems
  ☆471Updated 4 months ago
• Xirider / finetune-gpt2xl
  Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpe…
  ☆434Updated 2 years ago
• nyu-mll / GLUE-baselines
  [DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations
  ☆824Updated 4 years ago
• facebookresearch / vizseq
  An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)
  ☆449Updated last month
• clarkkev / attention-analysis
  ☆471Updated 4 years ago
• google-research / multilingual-t5
  ☆1,295Updated 3 years ago
• google-research / byt5
  ☆530Updated last year
• pltrdy / rouge
  A full Python Implementation of the ROUGE Metric (not a wrapper)
  ☆716Updated last year
• john-hewitt / structural-probes
  Codebase for testing whether hidden states of neural networks encode discrete structures.
  ☆399Updated last year
• allenai / unifiedqa
  UnifiedQA: Crossing Format Boundaries With a Single QA System
  ☆442Updated 3 years ago