Scalable and Performant Data Loading
☆397Aug 9, 2026Updated this week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆530Jul 16, 2026Updated 3 weeks ago
- Media decoding and encoding for PyTorch: videos, images, and audio, on CPU and GPU.☆1,156Updated this week
- A PyTorch native platform for training generative AI models☆5,621Updated this week
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,160Feb 9, 2026Updated 6 months ago
- PyTorch Single Controller☆1,067Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Schedule-Free Optimization in PyTorch☆2,323Jul 28, 2026Updated 2 weeks ago
- ☆21Mar 3, 2025Updated last year
- A Data Streaming Library for Efficient Neural Network Training☆1,545Jun 25, 2026Updated last month
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆288Nov 24, 2025Updated 8 months ago
- Helpful tools and examples for working with flex-attention☆1,224Updated this week
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- PyTorch native quantization for training and inference☆2,944Updated this week
- Latent Large Language Models☆19Aug 24, 2024Updated last year
- Framework for Algorithmic Correctness Testing of Operators☆16Mar 9, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- FAIR Sequence Modeling Toolkit 2☆1,144Updated this week
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆433Aug 5, 2026Updated last week
- Efficient Triton Kernels for LLM Training☆6,568Updated this week
- TensorDict is a pytorch dedicated tensor container.☆1,034Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,262Updated this week
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Nov 19, 2024Updated last year
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆995Updated this week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆365Updated this week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- torchcomms: a modern PyTorch communications API☆387Updated this week
- Applied AI experiments and examples for PyTorch☆323Aug 22, 2025Updated 11 months ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated 11 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆922Updated this week
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,994Jun 16, 2024Updated 2 years ago
- Library for reading and processing ML training data.☆766Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,490Updated this week
- A Quirky Assortment of CuTe Kernels☆1,107Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆379Dec 12, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Tile primitives for speedy kernels☆3,630Jul 13, 2026Updated last month
- Distributed Compiler based on Triton for Parallel Systems☆1,518Updated this week
- Muon fsdp 2☆64Aug 8, 2025Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆281Oct 3, 2025Updated 10 months ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆145Updated this week
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated 3 months ago
- ☆40Jul 26, 2024Updated 2 years ago