jcpeterson / openwebtext
Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.
☆731Updated 2 years ago
Alternatives and similar repositories for openwebtext:
Users that are interested in openwebtext are comparing it to the libraries listed below
- An open clone of the GPT-2 WebText dataset by OpenAI. Still WIP.☆389Updated last year
- Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpe…☆437Updated last year
- ☆501Updated last year
- Tools to download and cleanup Common Crawl data☆998Updated last year
- ☆1,555Updated last year
- Crawl BookCorpus☆828Updated last year
- ☆241Updated 5 years ago
- Scripts and links to recreate the ELI5 dataset.☆325Updated 3 years ago
- A Visual Analysis Tool to Explore Learned Representations in Transformers Models☆588Updated last year
- FastFormers - highly efficient transformer models for NLU☆705Updated 3 weeks ago
- Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.☆1,143Updated last year
- UnifiedQA: Crossing Format Boundaries With a Single QA System☆432Updated 2 years ago
- This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"☆1,628Updated last year
- jiant is an nlp toolkit☆1,665Updated last year
- Multi-angle c(q)uestion answering☆458Updated 2 years ago
- Mesh TensorFlow: Model Parallelism Made Easier☆1,604Updated last year
- DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.☆165Updated 2 weeks ago
- Repository for the paper "Optimal Subarchitecture Extraction for BERT"☆472Updated 2 years ago
- Fast BPE☆670Updated 10 months ago
- Dataset of GPT-2 outputs for research in detection, biases, and more☆1,975Updated last year
- Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch☆862Updated last year
- Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation☆989Updated 5 years ago
- 🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy☆1,379Updated 2 months ago
- Conditional Transformer Language Model for Controllable Generation☆1,882Updated 3 years ago
- Method to encode text for GPT-2 to generate text based on provided keywords☆260Updated 4 years ago
- BLEURT is a metric for Natural Language Generation based on transfer learning.☆726Updated last year
- 😇A pyTorch implementation of the DeepMoji model: state-of-the-art deep learning model for analyzing sentiment, emotion, sarcasm etc☆922Updated last year
- Code for the paper "Language Models are Unsupervised Multitask Learners"☆1,146Updated 2 years ago
- ☆1,270Updated 2 years ago
- Library for Knowledge Intensive Language Tasks☆938Updated 3 years ago