☆194Jun 3, 2026Updated last week
Alternatives and similar repositories for Emerging-Optimizers
Users that are interested in Emerging-Optimizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)☆13Feb 13, 2025Updated last year
- Combining SOAP and MUON☆22Feb 11, 2025Updated last year
- Official implementation for the paper "Controlled Sparsity via Constrained Optimization"☆12Aug 10, 2022Updated 3 years ago
- Physics, mathematics and computer science notes, mostly in Mandarin Chinese, some in English.☆12Updated this week
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆65Apr 8, 2026Updated 2 months ago
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆351May 20, 2026Updated 3 weeks ago
- Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…☆48Sep 2, 2025Updated 9 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆105Apr 7, 2026Updated 2 months ago
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆194May 29, 2026Updated last week
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆65Mar 11, 2025Updated last year
- Dion optimizer algorithm☆483Updated this week
- Efficient optimizers☆330May 13, 2026Updated 3 weeks ago
- ☆24Mar 1, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆269Dec 2, 2024Updated last year
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆39Jan 16, 2026Updated 4 months ago
- ☆30May 17, 2026Updated 3 weeks ago
- ☆198May 31, 2026Updated last week
- ☆52Mar 9, 2026Updated 3 months ago
- Why Low-Precision Transformer Training Fails: An Analysis on Flash Attention☆68Apr 7, 2026Updated 2 months ago
- Code and data recipes for the paper: Optimal Condition Training for Target Source Separation by Efthymios Tzinis, Gordon Wichern, Paris S…☆14Feb 15, 2023Updated 3 years ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 6 months ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Aug 30, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Accelerated Bregman Proximal Gradient Methods☆29Jun 12, 2023Updated 2 years ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆709Jan 26, 2026Updated 4 months ago
- Audio Entailment: Deductive Reasoning for Audio Understanding☆17Dec 10, 2024Updated last year
- This repository regroups learning ressources about performance estimation problems☆15Mar 18, 2026Updated 2 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆251Jun 15, 2025Updated 11 months ago
- My fork os allen AI's OLMo for educational purposes.☆28Dec 5, 2024Updated last year
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- ☆24Oct 10, 2025Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Apr 25, 2024Updated 2 years ago
- SQLStorm: Taking Database Benchmarking into the LLM Era☆87Jan 2, 2026Updated 5 months ago
- Official PyTorch implementation of "MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attacks"☆16Dec 4, 2025Updated 6 months ago
- ☆14Jun 22, 2025Updated 11 months ago
- Weird autoencoder experiments☆25May 20, 2026Updated 2 weeks ago
- Train to 94% on CIFAR-10 in 4.4 seconds on a single A100☆12Dec 30, 2023Updated 2 years ago
- ☆13Mar 10, 2026Updated 2 months ago