☆207Jun 27, 2026Updated this week
Alternatives and similar repositories for Emerging-Optimizers
Users that are interested in Emerging-Optimizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)☆13Feb 13, 2025Updated last year
- Official implementation for the paper "Controlled Sparsity via Constrained Optimization"☆12Aug 10, 2022Updated 3 years ago
- ☆68Apr 8, 2026Updated 2 months ago
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆354May 20, 2026Updated last month
- Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…☆49Sep 2, 2025Updated 9 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆105Apr 7, 2026Updated 2 months ago
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆197May 29, 2026Updated last month
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆65Mar 11, 2025Updated last year
- Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…☆49Apr 27, 2026Updated 2 months ago
- Dion optimizer algorithm☆492Updated this week
- VeLO optimizer in PyTorch☆20Feb 6, 2023Updated 3 years ago
- Efficient optimizers☆334Jun 21, 2026Updated last week
- ☆24Mar 1, 2022Updated 4 years ago
- Code for the paper: Unified Gradient Reweighting for Model Biasing with Applications to Source Separation☆14Nov 16, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆271Dec 2, 2024Updated last year
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆40Jan 16, 2026Updated 5 months ago
- Materials for HSE course "Applied Statistics in Machine Learning" taught during 2018.☆21Mar 21, 2024Updated 2 years ago
- ☆23Jan 5, 2025Updated last year
- ☆52Mar 9, 2026Updated 3 months ago
- ☆268Jun 9, 2026Updated 3 weeks ago
- [NeurIPS 2023] and [ICLR 2024] for robustness certification.☆10Nov 30, 2024Updated last year
- Code and data recipes for the paper: Optimal Condition Training for Target Source Separation by Efthymios Tzinis, Gordon Wichern, Paris S…☆14Feb 15, 2023Updated 3 years ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official repository of "NEnv: Neural Environment Maps for Global Illumination"☆22Aug 20, 2023Updated 2 years ago
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 7 months ago
- Accelerated Bregman Proximal Gradient Methods☆29Jun 12, 2023Updated 3 years ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆706Jan 26, 2026Updated 5 months ago
- Audio Entailment: Deductive Reasoning for Audio Understanding☆17Dec 10, 2024Updated last year
- GPU Affinity is a package to automatically set the CPU process affinity to match the hardware architecture on a given platform☆29Dec 8, 2023Updated 2 years ago
- Quantized LLM training in pure CUDA/C++.☆248Jun 3, 2026Updated 3 weeks ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆257Jun 15, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- My fork os allen AI's OLMo for educational purposes.☆28Dec 5, 2024Updated last year
- FastClassification is a tensorflow toolbox for class classification. It provides a training module with various backbones and training tr…☆15Jun 26, 2021Updated 5 years ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- ☆24Oct 10, 2025Updated 8 months ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Oct 7, 2024Updated last year
- Libraries for efficient and scalable group-structured dataset pipelines.☆25Jun 18, 2025Updated last year
- benchmarking some transformer deployments☆26Dec 15, 2025Updated 6 months ago