☆189May 15, 2026Updated this week
Alternatives and similar repositories for Emerging-Optimizers
Users that are interested in Emerging-Optimizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Combining SOAP and MUON☆21Feb 11, 2025Updated last year
- State-of-the-art framework for fast, large-scale training and inference of diffusion models☆54Apr 2, 2026Updated last month
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated 9 months ago
- ☆63Apr 8, 2026Updated last month
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆345Jan 5, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…☆48Sep 2, 2025Updated 8 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆100Apr 7, 2026Updated last month
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆190Mar 17, 2026Updated 2 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆65Mar 11, 2025Updated last year
- Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…☆48Apr 27, 2026Updated 3 weeks ago
- Dion optimizer algorithm☆476May 11, 2026Updated last week
- VeLO optimizer in PyTorch☆20Feb 6, 2023Updated 3 years ago
- Efficient optimizers☆326May 13, 2026Updated last week
- ☆24Mar 1, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆268Dec 2, 2024Updated last year
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆39Jan 16, 2026Updated 4 months ago
- ☆30May 10, 2026Updated last week
- Materials for HSE course "Applied Statistics in Machine Learning" taught during 2018.☆21Mar 21, 2024Updated 2 years ago
- ☆29Mar 30, 2026Updated last month
- ☆23Jan 5, 2025Updated last year
- ☆52Mar 9, 2026Updated 2 months ago
- Why Low-Precision Transformer Training Fails: An Analysis on Flash Attention☆66Apr 7, 2026Updated last month
- Code and data recipes for the paper: Optimal Condition Training for Target Source Separation by Efthymios Tzinis, Gordon Wichern, Paris S…☆14Feb 15, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [NeurIPS 2023] and [ICLR 2024] for robustness certification.☆10Nov 30, 2024Updated last year
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 6 months ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Aug 30, 2023Updated 2 years ago
- Minimal but scalable implementation of large language models in JAX☆35Nov 28, 2025Updated 5 months ago
- Accelerated Bregman Proximal Gradient Methods☆29Jun 12, 2023Updated 2 years ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated last year
- Audio Entailment: Deductive Reasoning for Audio Understanding☆17Dec 10, 2024Updated last year
- This repository regroups learning ressources about performance estimation problems☆15Mar 18, 2026Updated 2 months ago
- Quantized LLM training in pure CUDA/C++.☆246Mar 6, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆250Jun 15, 2025Updated 11 months ago
- FastClassification is a tensorflow toolbox for class classification. It provides a training module with various backbones and training tr…☆15Jun 26, 2021Updated 4 years ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- ☆23Oct 10, 2025Updated 7 months ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Oct 7, 2024Updated last year
- Libraries for efficient and scalable group-structured dataset pipelines.☆25Jun 18, 2025Updated 11 months ago
- benchmarking some transformer deployments☆26Dec 15, 2025Updated 5 months ago