Schedule-Free Optimization in PyTorch
☆2,337Jul 28, 2026Updated 3 months ago
Alternatives and similar repositories for schedule_free
Users that are interested in schedule_free are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Efficient optimizers☆340Sep 9, 2026Updated 2 months ago
- A PyTorch native platform for training generative AI models☆5,926Updated this week
- A dict[str, torch.Tensor] that behaves like one tensor, and TensorClass: typed, batched dataclasses that compile.☆1,046Updated this week
- For optimization algorithm research and development.☆585Oct 23, 2026Updated 3 weeks ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆981Nov 16, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Implementation of Diffusion Transformer (DiT) in JAX☆323Jun 11, 2024Updated 2 years ago
- Efficient Triton Kernels for LLM Training☆6,706Updated this week
- ☆290Dec 2, 2024Updated last year
- Muon is an optimizer for hidden layers in neural networks☆2,949May 24, 2026Updated 5 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆608Aug 14, 2026Updated 3 months ago
- Tile primitives for speedy kernels☆3,803Sep 12, 2026Updated 2 months ago
- maximal update parametrization (µP)☆1,757Jul 17, 2024Updated 2 years ago
- Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793☆463May 13, 2025Updated last year
- 🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch☆2,206Jul 9, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,638Aug 26, 2026Updated 2 months ago
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,773Jul 18, 2025Updated last year
- NanoGPT (124M) in 90 seconds☆6,053Sep 28, 2026Updated last month
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,899Jun 22, 2025Updated last year
- PyTorch native post-training library☆5,819Nov 9, 2026Updated last week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,275Aug 22, 2025Updated last year
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection☆1,714Oct 28, 2024Updated 2 years ago
- PyTorch native quantization for training and inference☆3,030Updated this week
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆10,582Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Helpful tools and examples for working with flex-attention☆1,268Updated this week
- Official repository for our work on micro-budget training of large-scale diffusion models.☆1,603Jan 12, 2025Updated last year
- The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”☆1,002Jan 30, 2024Updated 2 years ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,347Aug 26, 2025Updated last year
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,477Oct 12, 2026Updated last month
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆437Dec 12, 2024Updated last year
- UNet diffusion model in pure CUDA☆668Jun 28, 2024Updated 2 years ago
- Implementation for MatMul-free LM.☆3,101Sep 6, 2026Updated 2 months ago
- Mamba SSM architecture☆19,013Nov 8, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Fast and memory-efficient exact attention☆25,320Updated this week
- 🧱 Modula software package☆347Aug 18, 2025Updated last year
- Minimalistic large language model 3D-parallelism training☆2,868Oct 8, 2026Updated last month
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆5,966Updated this week
- 🚀 Efficient implementations for emerging model architectures☆6,066Updated this week
- A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes…☆4,847Jan 5, 2026Updated 10 months ago
- Accessible large language models via k-bit quantization for PyTorch.☆8,546Nov 2, 2026Updated 2 weeks ago
Are these results useful?