Alternatives and similar repositories for C-Optim

Users that are interested in C-Optim are comparing it to the libraries listed below

• AnonymousAlethiometer / SGD_SaI

  View on GitHub
  Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"
  ☆56Jan 27, 2025Updated last year
• kyleliang919 / Online-Subspace-Descent

  View on GitHub
  [NeurIPS 2024] Low rank memory efficient optimizer without SVD
  ☆33Jul 1, 2025Updated 7 months ago
• KellerJordan / Muon

  View on GitHub
  Muon is an optimizer for hidden layers in neural networks
  ☆2,290Jan 19, 2026Updated 3 weeks ago
• HomebrewML / HeavyBall

  View on GitHub
  Efficient optimizers
  ☆283Dec 20, 2025Updated last month
• zyushun / Adam-mini

  View on GitHub
  Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793
  ☆452May 13, 2025Updated 9 months ago
• deepglint / DanQing

  View on GitHub
  The official repo for the DanQing dataset.
  ☆29Jan 16, 2026Updated 3 weeks ago
• kyleliang919 / Super_Muon

  View on GitHub
  ☆67Mar 21, 2025Updated 10 months ago
• facebookresearch / schedule_free

  View on GitHub
  Schedule-Free Optimization in PyTorch
  ☆2,256May 21, 2025Updated 8 months ago
• USTC-StarTeam / ZIP

  View on GitHub
  ☆27Jul 11, 2024Updated last year
• bloc97 / DeMo

  View on GitHub
  DeMo: Decoupled Momentum Optimization
  ☆198Dec 2, 2024Updated last year
• LIONS-EPFL / scion

  View on GitHub
  ☆53Dec 17, 2025Updated last month
• Roblox / SmoothCache

  View on GitHub
  Implementation of SmoothCache, a project aimed at speeding-up Diffusion Transformer (DiT) based GenAI models with error-guided caching.
  ☆47Jul 17, 2025Updated 6 months ago
• frankxwang / dpo-prefix-sharing

  View on GitHub
  DPO, but faster 🚀
  ☆47Dec 6, 2024Updated last year
• GeneZC / MiniMA

  View on GitHub
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆102Jul 9, 2024Updated last year
• ahans30 / goldfish-loss

  View on GitHub
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆94Nov 17, 2024Updated last year
• yale-nlp / refdpo

  View on GitHub
  ☆16Jul 23, 2024Updated last year
• microsoft / mup

  View on GitHub
  maximal update parametrization (µP)
  ☆1,676Jul 17, 2024Updated last year
• GraphPKU / PiSSA

  View on GitHub
  PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)
  ☆409Jun 30, 2025Updated 7 months ago
• ytaek-oh / vl_compo

  View on GitHub
  ☆10Jul 5, 2024Updated last year
• xiaoxing2001 / DeGLA

  View on GitHub
  [ACM MM25] Official Pytorch implementation of [Decoupled Global-Local Alignment for Improving Compositional Understanding]
  ☆15Jul 15, 2025Updated 7 months ago
• Liuhong99 / Sophia

  View on GitHub
  The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
  ☆981Jan 30, 2024Updated 2 years ago
• iShohei220 / adopt

  View on GitHub
  Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"
  ☆434Dec 12, 2024Updated last year
• deepglint / MVT

  View on GitHub
  Margin-based Vision Transformer
  ☆66Nov 28, 2025Updated 2 months ago
• arubique / OCCAM

  View on GitHub
  This is an implementation of the paper "Are We Done with Object-Centric Learning?"
  ☆12Sep 11, 2025Updated 5 months ago
• zhuhanqing / APOLLO

  View on GitHub
  APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention
  ☆270Nov 29, 2025Updated 2 months ago
• pixeli99 / MixLN

  View on GitHub
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆29Jul 24, 2025Updated 6 months ago
• lucidrains / lion-pytorch

  View on GitHub
  🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
  ☆2,184Nov 27, 2024Updated last year
• jiaweizzhao / GaLore

  View on GitHub
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,672Oct 28, 2024Updated last year
• ClashLuke / SOAP

  View on GitHub
  ☆22Nov 9, 2024Updated last year
• Gunale0926 / Grams

  View on GitHub
  Grams: Gradient Descent with Adaptive Momentum Scaling (ICLR 2025 Workshop)
  ☆17Mar 6, 2025Updated 11 months ago
• SLIT-AI / WRPO

  View on GitHub
  [ICLR 2025] Weighted-Reward Preference Optimization for Implicit Model Fusion
  ☆13Mar 17, 2025Updated 10 months ago
• wookiekim / HCCNet

  View on GitHub
  Official PyTorch implementation of HCCNet: Efficient Semantic Matching with Hypercolumn Correlation (WACV '24 Oral, Best paper finalist (…
  ☆11Apr 29, 2024Updated last year
• BlinkDL / LinearAttentionArena

  View on GitHub
  Here we will test various linear attention designs.
  ☆62Apr 25, 2024Updated last year
• sangyun884 / rfpp

  View on GitHub
  The codebase of our paper "Improving the Training of Rectified Flows", NeurIPS 2024
  ☆128Oct 18, 2024Updated last year
• zhixuan-lin / forgetting-transformer

  View on GitHub
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆137Dec 19, 2025Updated last month
• apple / ml-cross-entropy

  View on GitHub
  ☆579Sep 23, 2025Updated 4 months ago
• huggingface / chug

  View on GitHub
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆160Apr 3, 2024Updated last year
• tensorgi / TPA

  View on GitHub
  [NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (T6) (https://arxiv.org/abs/2501.06425)
  ☆446Jan 26, 2026Updated 2 weeks ago
• SALT-NLP / demonstrated-feedback

  View on GitHub
  ☆130Oct 1, 2024Updated last year