MadryLab / modelcomponents

Related projects ⓘ

Alternatives and complementary repositories for modelcomponents

• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆78Updated 2 months ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆200Updated 5 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆123Updated 8 months ago
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆62Updated 3 months ago
• AvivBick / awesome-ssm-ml
  Reading list for research topics in state-space models
  ☆241Updated 2 weeks ago
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆103Updated 3 months ago
• abdelwahed / OT_for_big_data
  Optimal Transport in the Big Data Era
  ☆93Updated 2 weeks ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆169Updated last week
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆49Updated last week
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆120Updated last year
• test-time-training / ttt-lm-jax
  Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆366Updated 3 months ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆191Updated 9 months ago
• soniajoseph / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision Transformers (ViTs).
  ☆179Updated this week
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆174Updated this week
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆61Updated last week
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆128Updated 2 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆83Updated 2 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆137Updated last week
• KihoPark / linear_rep_geometry
  ☆76Updated 9 months ago
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆70Updated 8 months ago
• YihongDong / FAN
  ☆96Updated last week
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆85Updated 6 months ago
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆88Updated 10 months ago
• hyperevolnet / Terminator
  The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.
  ☆31Updated 2 months ago
• llm-random / llm-random
  ☆175Updated this week
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆70Updated 6 months ago
• kuleshov-group / awesome-discrete-diffusion-models
  A curated list for awesome discrete diffusion models resources.
  ☆67Updated last week
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆95Updated 6 months ago
• radarFudan / Awesome-state-space-models
  Collection of papers on state-space models
  ☆556Updated 2 weeks ago