Alternatives and similar repositories for Grams

Users that are interested in Grams are comparing it to the libraries listed below

• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆172Updated last week
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 9 months ago
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆84Updated 2 months ago
• lucidrains / deep-cross-attention
  Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch
  ☆96Updated 11 months ago
• RWKV-Vibe / rwkv-fla
  Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton
  ☆47Updated 5 months ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆49Updated last year
• lucidrains / simplicial-attention
  Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…
  ☆46Updated 5 months ago
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆83Updated last year
• fal-ai-community / NativeSparseAttention
  research impl of Native Sparse Attention (2502.11089)
  ☆63Updated 11 months ago
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆65Updated last week
• AnonymousAlethiometer / SGD_SaI
  Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"
  ☆56Updated last year
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆18Updated last year
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆88Updated last year
• kyleliang919 / Super_Muon
  ☆67Updated 10 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆135Updated 3 months ago
• nreHieW / minARImageGen
  Autoregressive Image Generation
  ☆31Updated 7 months ago
• yandex-research / vqdm
  Official repository for VQDM:Accurate Compression of Text-to-Image Diffusion Models via Vector Quantization paper
  ☆34Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆104Updated last year
• yynil / RWKVInside
  ☆41Updated 9 months ago
• KohakuBlueleaf / HDM
  Home Made Diffusion Models
  ☆187Updated 2 months ago
• TianjinYellow / SPAM-Optimizer
  ☆36Updated 10 months ago
• cloneofsimo / imagenet.int8
  ☆39Updated last year
• OpenMOSE / RWKV-Infer
  A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…
  ☆47Updated 3 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated last year
• kyegomez / SimpleMamba
  Implementation of a modular, high-performance, and simplistic mamba for high-speed applications
  ☆40Updated last year
• cloneofsimo / ptar
  ☆13Updated last year
• SwayStar123 / microdiffusion
  ☆48Updated 11 months ago
• Triang-jyed-driung / rwkv7mini
  RWKV-7 mini
  ☆12Updated 10 months ago
• Joluck / MiSS
  MiSS is a novel PEFT method that features a low-rank structure but introduces a new update mechanism distinct from LoRA, achieving an exc…
  ☆30Updated 2 weeks ago