Alternatives and similar repositories for openwebtext:

Users that are interested in openwebtext are comparing it to the libraries listed below

• yet-another-account / openwebtext
  An open clone of the GPT-2 WebText dataset by OpenAI. Still WIP.
  ☆387Updated 10 months ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆981Updated last year
• openai / summarize-from-feedback
  Code for "Learning to summarize from human feedback"
  ☆1,003Updated last year
• google-research / byt5
  ☆490Updated 11 months ago
• uber-research / PPLM
  Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
  ☆1,135Updated 11 months ago
• Xirider / finetune-gpt2xl
  Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpe…
  ☆437Updated last year
• nyu-mll / jiant
  jiant is an nlp toolkit
  ☆1,657Updated last year
• openai / gpt-2-output-dataset
  Dataset of GPT-2 outputs for research in detection, biases, and more
  ☆1,954Updated last year
• soskek / bookcorpus
  Crawl BookCorpus
  ☆814Updated last year
• EleutherAI / the-pile
  ☆1,528Updated last year
• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆712Updated last year
• nshepperd / gpt-2
  Code for the paper "Language Models are Unsupervised Multitask Learners"
  ☆1,147Updated 2 years ago
• facebookresearch / ELI5
  Scripts and links to recreate the ELI5 dataset.
  ☆320Updated 3 years ago
• huggingface / transfer-learning-conv-ai
  🦄 State-of-the-Art Conversational AI with Transfer Learning
  ☆1,745Updated last year
• graykode / gpt-2-Pytorch
  Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
  ☆979Updated 5 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆703Updated last year
• openai / finetune-transformer-lm
  Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
  ☆2,178Updated 6 years ago
• glample / fastBPE
  Fast BPE
  ☆659Updated 7 months ago
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆429Updated 2 years ago
• timoschick / pet
  This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"
  ☆1,626Updated last year
• google-deepmind / pg19
  ☆234Updated 4 years ago
• google-deepmind / narrativeqa
  This repository contains the NarrativeQA dataset. It includes the list of documents with Wikipedia summaries, links to full stories, and …
  ☆467Updated 4 years ago
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆857Updated last year
• salesforce / ctrl
  Conditional Transformer Language Model for Controllable Generation
  ☆1,874Updated 3 years ago
• bigscience-workshop / t-zero
  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
  ☆461Updated 2 years ago
• huggingface / pytorch-openai-transformer-lm
  🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
  ☆1,507Updated 3 years ago
• allenai / unifiedqa
  UnifiedQA: Crossing Format Boundaries With a Single QA System
  ☆430Updated 2 years ago
• google-research / multilingual-t5
  ☆1,262Updated 2 years ago
• golsun / DialogRPT
  EMNLP 2020: "Dialogue Response Ranking Training with Large-Scale Human Feedback Data"
  ☆336Updated 2 months ago
• PolyAI-LDN / conversational-datasets
  Large datasets for conversational AI
  ☆1,310Updated 5 years ago