Alternatives and similar repositories for SGD_SaI

Users that are interested in SGD_SaI are comparing it to the libraries listed below

• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆34Updated last year
• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆144Updated 2 months ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆107Updated last year
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆83Updated last year
• cloneofsimo / min-max-in-dit
  ☆27Updated last year
• cloneofsimo / imagenet.int8
  ☆39Updated last year
• OliverRensu / MVAR
  ☆71Updated last year
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆102Updated last year
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆56Updated 10 months ago
• lucasjinreal / ImageTokenizer
  imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…
  ☆40Updated last year
• declare-lab / EFLA
  Official Repo for Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics
  ☆70Updated 3 weeks ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆137Updated last month
• lucidrains / titok-pytorch
  Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"
  ☆183Updated last year
• RE-N-Y / imscore
  Minimal Differentiable Image Reward Functions
  ☆106Updated 5 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆134Updated 3 months ago
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆57Updated last year
• theAdamColton / vq-clip
  Train vector quantized CLIP models using pytorch lightning
  ☆20Updated last year
• nreHieW / minARImageGen
  Autoregressive Image Generation
  ☆31Updated 7 months ago
• SprocketLab / sparse_matrix_fine_tuning
  Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"
  ☆22Updated 3 months ago
• cloneofsimo / repa-rf
  ☆32Updated last year
• Lucky-Lance / TerDiT
  TerDiT: Ternary Diffusion Models with Transformers
  ☆74Updated last year
• cloneofsimo / minDinoV2
  ☆23Updated last year
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆112Updated last year
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆80Updated last year
• sayakpaul / simple-image-recaptioning
  Recaption large (Web)Datasets with vllm and save the artifacts.
  ☆52Updated last year
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆122Updated last year
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆168Updated 2 weeks ago
• LINs-lab / GMem
  [Preprint] GMem: A Modular Approach for Ultra-Efficient Generative Models
  ☆42Updated 10 months ago
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆59Updated 10 months ago
• lucidrains / LVMAE-pytorch
  Implementation of the proposed LVMAE, from the paper, Extending Video Masked Autoencoders to 128 frames, in Pytorch
  ☆55Updated last year