Alternatives and similar repositories for transformer_in_transformer

Users that are interested in transformer_in_transformer are comparing it to the libraries listed below

• gregorbachmann / scaling_mlps

  View on GitHub
  ☆52Jun 10, 2024Updated last year
• likenneth / q_probe

  View on GitHub
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆40Jun 10, 2024Updated last year
• KempnerInstitute / llm_uncertainty

  View on GitHub
  Code for the paper "Distinguishing the Knowable from the Unknowable with Language Models"
  ☆11Apr 15, 2024Updated last year
• mansheej / icl-task-diversity

  View on GitHub
  Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"
  ☆25Jun 28, 2023Updated 2 years ago
• facebookresearch / SparseBO

  View on GitHub
  code associated with paper "Sparse Bayesian Optimization"
  ☆26Oct 31, 2023Updated 2 years ago
• facebookresearch / MemoryMosaics

  View on GitHub
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆57Jan 30, 2025Updated last year
• joeljang / FLM

  View on GitHub
  All-in-one repository for Fine-tuning & Pretraining (Large) Language Models
  ☆15Mar 8, 2023Updated 2 years ago
• eric-mitchell / concord

  View on GitHub
  ☆12Nov 15, 2022Updated 3 years ago
• wesg52 / universal-neurons

  View on GitHub
  Universal Neurons in GPT2 Language Models
  ☆30May 28, 2024Updated last year
• fal-ai-community / nano-mdm

  View on GitHub
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆56Mar 10, 2025Updated 11 months ago
• stepelu / idbm-pytorch

  View on GitHub
  ☆13Sep 13, 2023Updated 2 years ago
• Vincentx15 / atom2D

  View on GitHub
  ☆12Nov 22, 2024Updated last year
• lsj2408 / URPE

  View on GitHub
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆34Aug 6, 2023Updated 2 years ago
• konstantinosKokos / ape

  View on GitHub
  🧮 Algebraic Positional Encodings.
  ☆18Aug 20, 2025Updated 5 months ago
• AlirezaMorsali / MLP-Attention

  View on GitHub
  ☆16Dec 19, 2024Updated last year
• EngSalem / HaLo

  View on GitHub
  ☆16Sep 27, 2023Updated 2 years ago
• boschresearch / adversarial_meta_embeddings

  View on GitHub
  Resources related to EMNLP 2021 paper "FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input Representations"
  ☆13Dec 14, 2021Updated 4 years ago
• affjljoo3581 / G2Net-Detecting-Continuous-Gravitational-Waves

  View on GitHub
  🥈12th place solution on G2Net Detecting Continuous Gravitational Waves🥈
  ☆14Jan 4, 2023Updated 3 years ago
• rw435 / wreathProdNet

  View on GitHub
  ☆13Nov 13, 2020Updated 5 years ago
• irhum / hyena

  View on GitHub
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Apr 27, 2023Updated 2 years ago
• vict0rsch / faenet

  View on GitHub
  ☆34Feb 12, 2025Updated last year
• ielab / CharacterBERT-DR

  View on GitHub
  The offcial repository for 'CharacterBERT and Self-Teaching for Improving the Robustness of Dense Retrievers on Queries with Typos', SIGI…
  ☆16May 4, 2022Updated 3 years ago
• MadryLab / bias-transfer

  View on GitHub
  ☆15Jul 24, 2022Updated 3 years ago
• epfml / REQ

  View on GitHub
  ☆19Jun 10, 2024Updated last year
• herrmann / rustorch

  View on GitHub
  "PyTorch in Rust"
  ☆17Feb 13, 2024Updated 2 years ago
• yang-song / yang-song.github.io

  View on GitHub
  Personal website
  ☆16Oct 19, 2025Updated 3 months ago
• mittagessen / curt

  View on GitHub
  ☆14Jul 11, 2022Updated 3 years ago
• HazyResearch / TART

  View on GitHub
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆202Jun 22, 2023Updated 2 years ago
• tml-epfl / why-weight-decay

  View on GitHub
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆70Sep 25, 2024Updated last year
• arobey1 / mbrdl

  View on GitHub
  Repository for reproducing `Model-Based Robust Deep Learning`
  ☆16Jan 22, 2021Updated 5 years ago
• nreHieW / loss

  View on GitHub
  Visualising Losses in Deep Neural Networks
  ☆16Jul 17, 2024Updated last year
• krafton-ai / AutoEvalGPT

  View on GitHub
  ☆20May 5, 2023Updated 2 years ago
• JeanKaddour / NoTrainNoGain

  View on GitHub
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Aug 30, 2023Updated 2 years ago
• csinva / mdl-complexity

  View on GitHub
  MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".
  ☆18Jun 12, 2023Updated 2 years ago
• TAU-VAILab / isbertblind

  View on GitHub
  This repository is for the paper "Is BERT Blind? Exploring the Effect of Vision-and-Language Pretraining on Visual Language Understanding…
  ☆20Nov 2, 2023Updated 2 years ago
• Noahs-ARK / RFA

  View on GitHub
  ☆33Apr 12, 2021Updated 4 years ago
• Curt-Park / serving-codegen-gptj-triton

  View on GitHub
  Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes
  ☆20May 30, 2023Updated 2 years ago
• Sreyan88 / ACLM

  View on GitHub
  Code for ACL 2023 Paper: ACLM: A Selective-Denoising based Generative Data Augmentation Approach for Low-Resource Complex NER
  ☆21Jul 19, 2023Updated 2 years ago
• eth-sri / fnf

  View on GitHub
  ☆16Apr 21, 2022Updated 3 years ago