google-deepmind / pg19
☆234Updated 4 years ago
Alternatives and similar repositories for pg19:
Users that are interested in pg19 are comparing it to the libraries listed below
- Repository containing code for "How to Train BERT with an Academic Budget" paper☆310Updated last year
- ☆316Updated 3 years ago
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆157Updated 2 years ago
- Scalable training for dense retrieval models.☆273Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆102Updated last year
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆187Updated 3 years ago
- A library for finding knowledge neurons in pretrained transformer models.☆153Updated 2 years ago
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆258Updated last year
- ☆97Updated 2 years ago
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆201Updated 3 years ago
- Adversarial Natural Language Inference Benchmark☆392Updated 2 years ago
- Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)☆461Updated 2 years ago
- A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!☆111Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- ☆67Updated 2 years ago
- ☆335Updated 9 months ago
- ☆124Updated this week
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆136Updated last year
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆129Updated 8 months ago
- ☆161Updated last year
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆272Updated 2 years ago
- HellaSwag: Can a Machine _Really_ Finish Your Sentence?☆188Updated 4 years ago
- WinoGrande: An Adversarial Winograd Schema Challenge at Scale☆90Updated 4 years ago
- An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"☆118Updated 2 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- Scaling Data-Constrained Language Models☆330Updated 3 months ago
- Task-based datasets, preprocessing, and evaluation for sequence models.☆566Updated this week
- FairSeq repo with Apollo optimizer☆108Updated last year
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆70Updated last year
- Evaluation suite for large-scale language models.☆124Updated 3 years ago