☆33Sep 10, 2024Updated last year
Alternatives and similar repositories for zeroshampoo
Users that are interested in zeroshampoo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Load & manage evolving datasets efficiently☆22Aug 22, 2025Updated 10 months ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- ☆93Jul 5, 2024Updated 2 years ago
- research impl of Native Sparse Attention (2502.11089)☆62Feb 19, 2025Updated last year
- ☆13Jun 3, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- WIP☆96Aug 13, 2024Updated last year
- ☆24Jun 18, 2024Updated 2 years ago
- ☆32Nov 4, 2024Updated last year
- ☆11Feb 26, 2024Updated 2 years ago
- PolarGrad: A Class of Matrix-Gradient Optimizers from a Unifying Preconditioning Perspective☆18Oct 1, 2025Updated 9 months ago
- ☆53Jan 6, 2024Updated 2 years ago
- ☆24Jun 4, 2024Updated 2 years ago
- ☆51Jan 18, 2024Updated 2 years ago
- Optimized primitives for collective multi-GPU communication☆11May 8, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- coloring terminal text with intensities (used for plotting probability, entropy with tokens)☆12Oct 11, 2024Updated last year
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆88Jul 28, 2024Updated last year
- The 2D discrete wavelet transform for JAX☆45Feb 28, 2023Updated 3 years ago
- ☆16Dec 11, 2025Updated 7 months ago
- Focused on fast experimentation and simplicity☆77Dec 24, 2024Updated last year
- Code for the paper "Function-Space Learning Rates"☆23Jun 3, 2025Updated last year
- ☆13Sep 13, 2023Updated 2 years ago
- Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"☆11Mar 31, 2024Updated 2 years ago
- ☆68Mar 21, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Efficient optimizers☆335Jul 11, 2026Updated last week
- Train VAE like a boss☆313Oct 21, 2024Updated last year
- ☆24Oct 15, 2024Updated last year
- CS341 for Spring 2024☆11Jul 15, 2024Updated 2 years ago
- Minimal implementation of multiple PEFT methods for LLaMA fine-tuning☆13May 7, 2023Updated 3 years ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆43Nov 9, 2023Updated 2 years ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆57Mar 10, 2025Updated last year
- ☆30Dec 2, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Source-to-Source Debuggable Derivatives in Pure Python☆15Jan 23, 2024Updated 2 years ago
- HGRN2: Gated Linear RNNs with State Expansion☆58Aug 20, 2024Updated last year
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆288Nov 24, 2025Updated 7 months ago
- Memory Efficient Training Framework for Large Video Generation Model☆25Apr 22, 2024Updated 2 years ago
- Dyna built on R-exprs (First Prototype)☆17Mar 7, 2022Updated 4 years ago
- Various transformers for FSDP research☆38Nov 11, 2022Updated 3 years ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆46May 23, 2023Updated 3 years ago