Code for "The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training"
☆11Feb 4, 2026Updated 8 months ago
Alternatives and similar repositories for lr-scheduling
Users that are interested in lr-scheduling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pretraining codebase for Apertus models, based on Megatron-LM☆23Oct 2, 2026Updated 3 weeks ago
- ☆12Oct 24, 2025Updated last year
- CFR implementation of a poker bot.☆12Feb 17, 2023Updated 3 years ago
- Benchmarking Optimizers for LLM Pretraining. NeurIPS 2026, EurIPS 2025☆61May 3, 2026Updated 5 months ago
- Native Julia implementation of the Performance Estimation Programming (PEP) methodology☆14Jun 22, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Oct 12, 2026Updated 2 weeks ago
- Research code for FKFlow Paper☆16Oct 16, 2026Updated last week
- This repository regroups learning ressources about performance estimation problems☆15Mar 18, 2026Updated 7 months ago
- ☆12Dec 22, 2021Updated 4 years ago
- ☆14Mar 2, 2025Updated last year
- Run TensorFlow on ESP32 chips without pain☆11Dec 27, 2023Updated 2 years ago
- ☆19Nov 6, 2024Updated last year
- Julia package interfacing the Fortran code MPBNGC.☆12Jun 28, 2025Updated last year
- nanoGPT-like codebase for LLM training☆120Nov 7, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [NeurIPS 2024] Low rank memory efficient optimizer without SVD☆34Jul 1, 2025Updated last year
- Compressed sparse matrices☆15Jun 12, 2024Updated 2 years ago
- Optimization Models and Algorithms☆18May 4, 2026Updated 5 months ago
- Algorithms Lab @ ETH Zurich, Fall 21☆23Feb 10, 2022Updated 4 years ago
- ☆19Jun 23, 2023Updated 3 years ago
- Solving Inverse Problems with Diffusion Optimal Control [NeurIPS 2024]☆19Dec 21, 2024Updated last year
- A VS Code extension that opens Markdown files in a Notion-like, block-based WYSIWYG editor while preserving the underlying file as plain …☆21Jan 19, 2026Updated 9 months ago
- AES Tutorial 2021, Deep Learning for Audio☆14Aug 28, 2024Updated 2 years ago
- FAST (Finally An SDDP Toolbox) is an SDDP toolbox for Matlab☆24Mar 4, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆94Oct 30, 2024Updated last year
- A suite of stochastic optimization methods for solving the empirical risk minimization problem.☆17Nov 20, 2019Updated 6 years ago
- ☆24Jun 1, 2025Updated last year
- An implementation of LassoNet for arbitrary network architectures☆14Nov 4, 2022Updated 3 years ago
- MoMo: Momentum Models for Adaptive Learning Rates☆19Jun 12, 2024Updated 2 years ago
- A Python Package for Portfolio Optimization using the Critical Line Algorithm☆27Aug 1, 2023Updated 3 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- Code for paper "Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation" (ICLR'24)☆13Nov 17, 2023Updated 2 years ago
- ☆10Jun 19, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Materials for an Integer Programming course at University of Pavia☆19May 20, 2022Updated 4 years ago
- A latent diffusion model for visual synthesis of plant images.☆17Nov 1, 2022Updated 3 years ago
- Source code for my PhD thesis: Backpropagation Beyond the Gradient☆21Feb 25, 2023Updated 3 years ago
- A short introduction to program synthesis and the ARC challenge☆12Jul 30, 2025Updated last year
- Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.☆27Sep 29, 2024Updated 2 years ago
- ☆12Dec 2, 2025Updated 10 months ago
- KL3M tokenizers☆15Apr 24, 2025Updated last year