google-deepmind / pg19

Related projects ⓘ

Alternatives and complementary repositories for pg19

• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆309Updated last year
• urvashik / knnlm
  ☆315Updated 3 years ago
• facebookresearch / PAQ
  Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"
  ☆202Updated 3 years ago
• EleutherAI / knowledge-neurons
  A library for finding knowledge neurons in pretrained transformer models.
  ☆151Updated 2 years ago
• bigscience-workshop / t-zero
  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
  ☆457Updated 2 years ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆177Updated 2 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆328Updated 2 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆111Updated last year
• google / seqio
  Task-based datasets, preprocessing, and evaluation for sequence models.
  ☆561Updated this week
• timoschick / dino
  This repository contains the code for "Generating Datasets with Pretrained Language Models".
  ☆187Updated 3 years ago
• facebookresearch / NPM
  The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)
  ☆156Updated last year
• pmichel31415 / are-16-heads-really-better-than-1
  Code for the paper "Are Sixteen Heads Really Better than One?"
  ☆169Updated 4 years ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆271Updated last year
• microsoft / MPNet
  MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf
  ☆288Updated 3 years ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆101Updated last year
• princeton-nlp / DinkyTrain
  Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration 🚃
  ☆112Updated 2 years ago
• facebookresearch / anli
  Adversarial Natural Language Inference Benchmark
  ☆389Updated 2 years ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆310Updated 3 years ago
• facebookresearch / MetaICL
  An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi
  ☆254Updated last year
• tianjunz / HIR
  ☆158Updated last year
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆172Updated 2 years ago
• r-three / t-few
  Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"
  ☆431Updated last year
• neulab / knn-transformers
  PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…
  ☆269Updated 2 years ago
• martiansideofthemoon / rankgen
  Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…
  ☆136Updated last year
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆68Updated 10 months ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆132Updated 5 years ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆127Updated 6 months ago
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆107Updated 11 months ago
• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆697Updated last year