soskek / bookcorpus
Crawl BookCorpus
☆819Updated last year
Alternatives and similar repositories for bookcorpus:
Users that are interested in bookcorpus are comparing it to the libraries listed below
- Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.☆1,138Updated last year
- This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"☆1,627Updated last year
- Fast BPE☆662Updated 8 months ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,899Updated 2 years ago
- jiant is an nlp toolkit☆1,661Updated last year
- An open clone of the GPT-2 WebText dataset by OpenAI. Still WIP.☆387Updated 10 months ago
- Tools to download and cleanup Common Crawl data☆983Updated last year
- An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)☆443Updated 3 months ago
- Conditional Transformer Language Model for Controllable Generation☆1,875Updated 3 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,219Updated 6 months ago
- ☆494Updated last year
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,347Updated 10 months ago
- BLEURT is a metric for Natural Language Generation based on transfer learning.☆715Updated last year
- Resources for the NAACL 2018 paper "A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents"☆364Updated last year
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,194Updated 4 months ago
- High-accuracy NLP parser with models for 11 languages.☆880Updated 3 years ago
- A Visual Analysis Tool to Explore Learned Representations in Transformers Models☆587Updated last year
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…☆430Updated 2 years ago
- Evaluating Cross-lingual Sentence Representations☆449Updated 3 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,101Updated last month
- Python port of Moses tokenizer, truecaser and normalizer☆489Updated 8 months ago
- Paper List for Style Transfer in Text☆1,621Updated last year
- Repository for the paper "Optimal Subarchitecture Extraction for BERT"☆471Updated 2 years ago
- ☆1,263Updated 2 years ago
- Simple, fast unsupervised word aligner☆744Updated 2 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,118Updated 2 years ago
- Longformer: The Long-Document Transformer☆2,082Updated 2 years ago
- Code and model for the paper "Improving Language Understanding by Generative Pre-Training"☆2,189Updated 6 years ago
- ☆1,533Updated last year
- Visually Explore the Stanford Question Answering Dataset☆558Updated last year