google-deepmind / pg19
☆241Updated 5 years ago
Alternatives and similar repositories for pg19:
Users that are interested in pg19 are comparing it to the libraries listed below
- Repository containing code for "How to Train BERT with an Academic Budget" paper☆313Updated last year
- ☆318Updated 3 years ago
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆202Updated 3 years ago
- Adversarial Natural Language Inference Benchmark☆393Updated 2 years ago
- Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)☆464Updated 2 years ago
- A library for finding knowledge neurons in pretrained transformer models.☆155Updated 3 years ago
- A framework for few-shot evaluation of autoregressive language models.☆103Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆180Updated 2 years ago
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆262Updated 2 years ago
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆177Updated 2 years ago
- ☆131Updated 3 months ago
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆271Updated 2 years ago
- Evaluation suite for large-scale language models.☆125Updated 3 years ago
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆157Updated 2 years ago
- ☆159Updated 2 years ago
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆171Updated 5 years ago
- Understanding the Difficulty of Training Transformers☆329Updated 2 years ago
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆134Updated 11 months ago
- Task-based datasets, preprocessing, and evaluation for sequence models.☆572Updated this week
- UnifiedQA: Crossing Format Boundaries With a Single QA System☆432Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 3 years ago
- Scalable training for dense retrieval models.☆290Updated last month
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆154Updated last year
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆207Updated 3 months ago
- DSIR large-scale data selection framework for language model training☆245Updated last year
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆136Updated last year
- A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!☆111Updated last year
- Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.☆285Updated 9 months ago
- [EMNLP 2021] Improving and Simplifying Pattern Exploiting Training☆154Updated 2 years ago