soskek / bookcorpusLinks
Crawl BookCorpus
☆833Updated last year
Alternatives and similar repositories for bookcorpus
Users that are interested in bookcorpus are comparing it to the libraries listed below
Sorting:
- Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.☆1,146Updated last year
- ☆1,572Updated 2 years ago
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…☆433Updated 2 years ago
- An open clone of the GPT-2 WebText dataset by OpenAI. Still WIP.☆389Updated last year
- ☆507Updated last year
- Fast BPE☆671Updated 11 months ago
- jiant is an nlp toolkit☆1,667Updated last year
- Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.☆731Updated 2 years ago
- XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 ty…☆644Updated 2 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,353Updated last year
- Tools to download and cleanup Common Crawl data☆1,010Updated 2 years ago
- Code and model for the paper "Improving Language Understanding by Generative Pre-Training"☆2,209Updated 6 years ago
- ☆462Updated 4 years ago
- BLEURT is a metric for Natural Language Generation based on transfer learning.☆733Updated last year
- Repository for the paper "Optimal Subarchitecture Extraction for BERT"☆472Updated 2 years ago
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,212Updated 8 months ago
- 🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI☆1,509Updated 3 years ago
- Natural Questions (NQ) contains real user questions issued to Google search, and answers found from Wikipedia by annotators. NQ is design…☆1,009Updated 3 years ago
- A Visual Analysis Tool to Explore Learned Representations in Transformers Models☆591Updated last year
- ☆243Updated 5 years ago
- ☆1,275Updated 2 years ago
- This repository contains the NarrativeQA dataset. It includes the list of documents with Wikipedia summaries, links to full stories, and …☆478Updated 5 years ago
- A tool for holistic analysis of language generations systems☆468Updated 3 years ago
- Codebase for testing whether hidden states of neural networks encode discrete structures.☆391Updated last year
- Language-Agnostic SEntence Representations☆3,640Updated last year
- This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, an…☆557Updated 3 years ago
- This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"☆1,630Updated last year
- Shared repository for open-sourced projects from the Google AI Language team.☆1,676Updated last month
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,801Updated 2 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,142Updated 2 months ago