Alternatives and similar repositories for chai

Users that are interested in chai are comparing it to the libraries listed below

• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆41Updated last year
• akhilkedia / TranformersGetStable
  [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"
  ☆10Updated last year
• taehong-moon / ee-diffusion
  Official Code Implementation for 'A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Models'
  ☆20Updated last year
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆25Updated 10 months ago
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 10 months ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆45Updated 2 years ago
• yandex-research / vqdm
  Official repository for VQDM:Accurate Compression of Text-to-Image Diffusion Models via Vector Quantization paper
  ☆33Updated 11 months ago
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆54Updated 7 months ago
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆17Updated last year
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆33Updated last year
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆40Updated last year
• hamishivi / tess-2
  Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"
  ☆51Updated 6 months ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆125Updated last month
• lucidrains / simplicial-attention
  Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…
  ☆46Updated last week
• cloneofsimo / ptar
  ☆13Updated last year
• cloneofsimo / min-max-in-dit
  ☆27Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆62Updated last year
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆56Updated last year
• jadehaus / preference-flow-matching
  Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)
  ☆58Updated 10 months ago
• cloneofsimo / repa-rf
  ☆32Updated 10 months ago
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆85Updated last year
• cloneofsimo / karras-power-ema-tutorial
  ☆53Updated last year
• MarkXCloud / CSpD
  The official repo of continuous speculative decoding
  ☆27Updated 5 months ago
• snu-mllab / LayerMerge
  Official PyTorch implementation of "LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging" (ICML 2024)
  ☆30Updated last year
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• lucidrains / deep-cross-attention
  Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch
  ☆92Updated 6 months ago
• yang-song / yang-song.github.io
  Personal website
  ☆15Updated 2 months ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆53Updated 5 months ago
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• brianfitzgerald / jax-mmdit
  Implementation of Diffusion Transformers and Rectified Flow in Jax
  ☆25Updated last year