Scalable and Performant Data Loading
☆398Sep 1, 2026Updated this week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆535Updated this week
- Media decoding and encoding for PyTorch: videos, images, and audio, on CPU and GPU.☆1,161Updated this week
- A PyTorch native platform for training generative AI models☆5,692Updated this week
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,175Feb 9, 2026Updated 6 months ago
- PyTorch Single Controller☆1,072Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Schedule-Free Optimization in PyTorch☆2,324Jul 28, 2026Updated last month
- ☆21Mar 3, 2025Updated last year
- A Data Streaming Library for Efficient Neural Network Training☆1,554Jun 25, 2026Updated 2 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆288Nov 24, 2025Updated 9 months ago
- Helpful tools and examples for working with flex-attention☆1,233Updated this week
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- PyTorch native quantization for training and inference☆2,960Updated this week
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Framework for Algorithmic Correctness Testing of Operators☆16Mar 9, 2026Updated 5 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- FAIR Sequence Modeling Toolkit 2☆1,145Aug 10, 2026Updated 3 weeks ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆432Aug 5, 2026Updated 3 weeks ago
- Efficient Triton Kernels for LLM Training☆6,597Updated this week
- TensorDict is a pytorch dedicated tensor container.☆1,035Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,264Updated this week
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Nov 19, 2024Updated last year
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆1,004Aug 12, 2026Updated 3 weeks ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆367Updated this week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- torchcomms: a modern PyTorch communications API☆391Updated this week
- Applied AI experiments and examples for PyTorch☆323Aug 22, 2025Updated last year
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆930Updated this week
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,993Jun 16, 2024Updated 2 years ago
- Library for reading and processing ML training data.☆774Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,517Updated this week
- A Quirky Assortment of CuTe Kernels☆1,135Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆379Dec 12, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tile primitives for speedy kernels☆3,660Updated this week
- Distributed Compiler and Optimized Parallel Kernels☆1,530Aug 12, 2026Updated 3 weeks ago
- Muon fsdp 2☆65Aug 8, 2025Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆280Oct 3, 2025Updated 11 months ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆149Updated this week
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated 4 months ago
- ☆40Jul 26, 2024Updated 2 years ago