Alternatives and similar repositories for awesome-transformers:

Users that are interested in awesome-transformers are comparing it to the libraries listed below

• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆103Updated last year
• qkaren / COLD_decoding
  ☆105Updated 2 years ago
• lee-ny / teaching_arithmetic
  ☆78Updated last year
• PiotrNawrot / dynamic-pooling
  Efficient Transformers with Dynamic Token Pooling
  ☆60Updated last year
• EdinburghNLP / torch-adaptive-imle
  ☆34Updated 3 months ago
• deep-spin / infinite-former
  ☆64Updated 6 months ago
• FranxYao / Distributional-Generalization-in-Natural-Language-Processing
  Distributional Generalization in NLP. A roadmap.
  ☆87Updated 2 years ago
• libeineu / ODE-Transformer
  This is a code repository for the ACL 2022 paper "ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generati…
  ☆29Updated 2 years ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆74Updated last year
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆35Updated last year
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆51Updated last month
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆43Updated last year
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆159Updated 9 months ago
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆149Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆58Updated last year
• UKPLab / adaptable-adapters
  ☆24Updated 2 years ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆66Updated last year
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆130Updated 10 months ago
• zlin7 / UQ-NLG
  ☆84Updated 8 months ago
• srush / mamba-primer
  ☆37Updated 11 months ago
• google-deepmind / emergent_in_context_learning
  ☆81Updated 7 months ago
• google-research / meliad
  ☆253Updated 2 years ago
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆61Updated 2 years ago
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆33Updated 3 years ago
• automl / TransformersCanDoBayesianInference
  Official Implementation of "Transformers Can Do Bayesian Inference", the PFN paper
  ☆206Updated 4 months ago
• bigscience-workshop / architecture-objective
  ☆95Updated last year
• rosewang2008 / language_modeling_via_stochastic_processes
  Language modeling via stochastic processes. Oral @ ICLR 2022.
  ☆137Updated last year
• Johswald / awesome-hypernetworks
  ☆60Updated 3 years ago
• aadityasingh / icl-dynamics
  ☆16Updated 10 months ago