☆156Updated this week
Alternatives and similar repositories for Emerging-Optimizers
Users that are interested in Emerging-Optimizers are comparing it to the libraries listed below
Sorting:
- 4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)☆13Feb 13, 2025Updated last year
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 6 months ago
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆166Jan 22, 2026Updated last month
- Official implementation for the paper "Controlled Sparsity via Constrained Optimization"☆11Aug 10, 2022Updated 3 years ago
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆322Jan 5, 2026Updated last month
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆34Jan 16, 2026Updated last month
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆28Aug 19, 2025Updated 6 months ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 3 months ago
- ☆50Aug 21, 2025Updated 6 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆18Jul 24, 2025Updated 7 months ago
- ☆55Updated this week
- ☆20Oct 10, 2025Updated 4 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆237Jun 15, 2025Updated 8 months ago
- Official repository of "NEnv: Neural Environment Maps for Global Illumination"☆22Aug 20, 2023Updated 2 years ago
- ☆23Jan 5, 2025Updated last year
- ☆20Sep 28, 2024Updated last year
- Efficient optimizers☆285Dec 20, 2025Updated 2 months ago
- Dion optimizer algorithm☆438Jan 16, 2026Updated last month
- A simple calculation for LLM MFU.☆69Sep 10, 2025Updated 5 months ago
- possibly useful materials for learning RWKV language model.☆26Jun 8, 2023Updated 2 years ago
- High-res 3D Occupancy Dataset for Unified 3D Scene Understanding.☆29Jul 14, 2024Updated last year
- benchmarking some transformer deployments☆26Dec 15, 2025Updated 2 months ago
- ☆129Jun 6, 2025Updated 8 months ago
- Accelerating MoE with IO and Tile-aware Optimizations☆591Updated this week
- Accelerated Bregman Proximal Gradient Methods☆29Jun 12, 2023Updated 2 years ago
- Libraries for efficient and scalable group-structured dataset pipelines.☆25Jun 18, 2025Updated 8 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆63Mar 11, 2025Updated 11 months ago
- ☆24Jan 27, 2025Updated last year
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆766Updated this week
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- Build compute kernels and load them from the Hub.☆452Updated this week
- Sparse Backpropagation for Mixture-of-Expert Training☆29Jul 2, 2024Updated last year
- ☆252Dec 2, 2024Updated last year
- [WIP] Better (FP8) attention for Hopper☆32Feb 24, 2025Updated last year
- ☆87Updated this week
- Minimal but scalable implementation of large language models in JAX☆35Nov 28, 2025Updated 3 months ago
- The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…☆84Jan 12, 2025Updated last year
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- ☆13Nov 5, 2024Updated last year