google-deepmind / pg19
☆235Updated 4 years ago
Alternatives and similar repositories for pg19:
Users that are interested in pg19 are comparing it to the libraries listed below
- ☆316Updated 3 years ago
- Repository containing code for "How to Train BERT with an Academic Budget" paper☆311Updated last year
- ☆124Updated last month
- A framework for few-shot evaluation of autoregressive language models.☆102Updated last year
- A library for finding knowledge neurons in pretrained transformer models.☆154Updated 3 years ago
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- Scalable training for dense retrieval models.☆275Updated last year
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆202Updated 3 years ago
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆259Updated last year
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆157Updated 2 years ago
- Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)☆461Updated 2 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- Adversarial Natural Language Inference Benchmark☆396Updated 2 years ago
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆130Updated 9 months ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆202Updated last month
- Task-based datasets, preprocessing, and evaluation for sequence models.☆568Updated this week
- ☆160Updated last year
- A algebraic word problem dataset, with multiple choice questions annotated with rationales.☆308Updated 7 years ago
- A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!☆111Updated last year
- Efficient, check-pointed data loading for deep learning with massive data sets.☆205Updated last year
- An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"☆117Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆187Updated 3 years ago
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆136Updated last year
- ☆67Updated 2 years ago
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆69Updated last year
- Understanding the Difficulty of Training Transformers☆328Updated 2 years ago
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆271Updated 2 years ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆144Updated 9 months ago
- FairSeq repo with Apollo optimizer☆110Updated last year