Alternatives and similar repositories for gidd:

Users that are interested in gidd are comparing it to the libraries listed below

• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆44Updated 2 weeks ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆80Updated this week
• NVlabs / GatedDeltaNet
  [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule
  ☆143Updated last week
• kyleliang919 / Super_Muon
  ☆47Updated last week
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆70Updated 3 months ago
• sustcsonglin / linear-attention-and-beyond-slides
  ☆65Updated last month
• zacharyhorvitz / Fk-Diffusion-Steering
  A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.
  ☆112Updated last month
• fal-ai-community / NativeSparseAttention
  research impl of Native Sparse Attention (2502.11089)
  ☆53Updated last month
• HKUNLP / DiffuLLaMA
  [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆120Updated last week
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆164Updated 4 months ago
• google-deepmind / md4
  Official Jax Implementation of MD4 Masked Diffusion Models
  ☆70Updated last month
• igul222 / plaid
  ☆91Updated last year
• kyleliang919 / C-Optim
  When it comes to optimizers, it's always better to be safe than sorry
  ☆214Updated this week
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆122Updated 7 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆49Updated 2 weeks ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆27Updated last month
• cloneofsimo / minSAE
  ☆24Updated 3 months ago
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆47Updated last week
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆110Updated 2 months ago
• fal-ai-community / minDDPD
  ☆33Updated 2 months ago
• liusulin / DDPD
  Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]
  ☆54Updated this week
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆80Updated 3 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated 11 months ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆62Updated 7 months ago
• cloneofsimo / min-max-in-dit
  ☆27Updated 10 months ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆101Updated 9 months ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆212Updated last year
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆75Updated 4 months ago
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆78Updated last month
• RobertCsordas / moeut
  ☆74Updated 7 months ago