Alternatives and similar repositories for pg19:

Users that are interested in pg19 are comparing it to the libraries listed below

• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆312Updated last year
• urvashik / knnlm
  ☆318Updated 3 years ago
• facebookresearch / NPM
  The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)
  ☆157Updated 2 years ago
• facebookresearch / PAQ
  Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"
  ☆202Updated 3 years ago
• facebookresearch / anli
  Adversarial Natural Language Inference Benchmark
  ☆393Updated 2 years ago
• facebookresearch / MetaICL
  An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi
  ☆260Updated last year
• nyu-mll / quality
  ☆128Updated 2 months ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆284Updated 3 weeks ago
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆110Updated last year
• bigscience-workshop / t-zero
  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
  ☆463Updated 2 years ago
• EleutherAI / knowledge-neurons
  A library for finding knowledge neurons in pretrained transformer models.
  ☆155Updated 3 years ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated last year
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆134Updated 5 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• tianjunz / HIR
  ☆159Updated 2 years ago
• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆75Updated 4 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆111Updated last year
• neulab / knn-transformers
  PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…
  ☆270Updated 2 years ago
• facebookresearch / ELI5
  Scripts and links to recreate the ELI5 dataset.
  ☆324Updated 3 years ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆131Updated 10 months ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆309Updated 3 years ago
• ari-holtzman / degen
  Official Repository for "The Curious Case of Neural Text Degeneration"
  ☆161Updated last year
• google / seqio
  Task-based datasets, preprocessing, and evaluation for sequence models.
  ☆571Updated this week
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆149Updated last year
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆179Updated 2 years ago
• tanyuqian / ctc-gen-eval
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆96Updated 2 years ago
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• google-research / longt5
  ☆182Updated last year
• google / flaxformer
  ☆343Updated 11 months ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆153Updated last year