☆164Mar 17, 2026Updated this week
Alternatives and similar repositories for Emerging-Optimizers
Users that are interested in Emerging-Optimizers are comparing it to the libraries listed below
Sorting:
- Combining SOAP and MUON☆19Feb 11, 2025Updated last year
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆18Jul 24, 2025Updated 7 months ago
- ☆56Feb 24, 2026Updated 3 weeks ago
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 7 months ago
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆331Jan 5, 2026Updated 2 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆96Mar 5, 2026Updated 2 weeks ago
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆176Updated this week
- Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…☆43Updated this week
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆63Mar 11, 2025Updated last year
- Dion optimizer algorithm☆453Jan 16, 2026Updated 2 months ago
- Efficient optimizers☆294Updated this week
- VeLO optimizer in PyTorch☆20Feb 6, 2023Updated 3 years ago
- Code for the paper: Unified Gradient Reweighting for Model Biasing with Applications to Source Separation☆14Nov 16, 2020Updated 5 years ago
- ☆24Mar 1, 2022Updated 4 years ago
- ☆255Dec 2, 2024Updated last year
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆36Jan 16, 2026Updated 2 months ago
- ☆29Sep 30, 2025Updated 5 months ago
- ☆25Updated this week
- ☆23Jan 5, 2025Updated last year
- Code and data recipes for the paper: Optimal Condition Training for Target Source Separation by Efthymios Tzinis, Gordon Wichern, Paris S…☆14Feb 15, 2023Updated 3 years ago
- Official repository of "NEnv: Neural Environment Maps for Global Illumination"☆22Aug 20, 2023Updated 2 years ago
- Minimal but scalable implementation of large language models in JAX☆35Nov 28, 2025Updated 3 months ago
- Accelerated Bregman Proximal Gradient Methods☆29Jun 12, 2023Updated 2 years ago
- huggingface dataset with remote download support☆11Mar 13, 2026Updated last week
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated last year
- Audio Entailment: Deductive Reasoning for Audio Understanding☆17Dec 10, 2024Updated last year
- ☆20Oct 10, 2025Updated 5 months ago
- This repository regroups learning ressources about performance estimation problems☆15Updated this week
- GPU Affinity is a package to automatically set the CPU process affinity to match the hardware architecture on a given platform☆29Dec 8, 2023Updated 2 years ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆242Jun 15, 2025Updated 9 months ago
- My fork os allen AI's OLMo for educational purposes.☆28Dec 5, 2024Updated last year
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- Optimization methods course at MIPT☆12Apr 24, 2018Updated 7 years ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Oct 7, 2024Updated last year
- Official PyTorch implementation of "MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attacks"☆12Dec 4, 2025Updated 3 months ago
- benchmarking some transformer deployments☆26Dec 15, 2025Updated 3 months ago
- A Signal Propagation Perspective for Pruning Neural Networks at Initialization☆14Jun 23, 2020Updated 5 years ago
- Official Repo For AAAI 2026 Accepted Paper "Rethinking the Spatio-Temporal Alignment of End-to-End 3D Perception"☆29Jan 13, 2026Updated 2 months ago
- KANs and MLPs☆12Jun 7, 2024Updated last year