Scalable and Performant Data Loading
☆399Oct 8, 2026Updated this week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆545Updated this week
- Media decoding and encoding for PyTorch: videos, images, and audio, on CPU and GPU.☆1,183Updated this week
- A PyTorch native platform for training generative AI models☆5,799Updated this week
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,208Feb 9, 2026Updated 8 months ago
- PyTorch Single Controller☆1,078Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Schedule-Free Optimization in PyTorch☆2,329Jul 28, 2026Updated 2 months ago
- ☆21Mar 3, 2025Updated last year
- A Data Streaming Library for Efficient Neural Network Training☆1,565Jun 25, 2026Updated 3 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆288Nov 24, 2025Updated 10 months ago
- Helpful tools and examples for working with flex-attention☆1,257Updated this week
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- PyTorch native quantization for training and inference☆3,002Updated this week
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Framework for Algorithmic Correctness Testing of Operators☆18Mar 9, 2026Updated 7 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- FAIR Sequence Modeling Toolkit 2☆1,152Sep 8, 2026Updated last month
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆434Aug 5, 2026Updated 2 months ago
- Efficient Triton Kernels for LLM Training☆6,655Updated this week
- TensorDict is a pytorch dedicated tensor container.☆1,039Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,266Sep 16, 2026Updated 3 weeks ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Nov 19, 2024Updated last year
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆1,007Sep 15, 2026Updated 3 weeks ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆372Updated this week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- torchcomms: a modern PyTorch communications API☆400Updated this week
- Applied AI experiments and examples for PyTorch☆322Aug 22, 2025Updated last year
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆960Updated this week
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,994Jun 16, 2024Updated 2 years ago
- Library for reading and processing ML training data.☆789Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,576Updated this week
- A Quirky Assortment of CuTe Kernels☆1,172Sep 17, 2026Updated 3 weeks ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆386Dec 12, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tile primitives for speedy kernels☆3,748Sep 12, 2026Updated last month
- Distributed Compiler and Optimized Parallel Kernels☆1,564Sep 18, 2026Updated 3 weeks ago
- Muon fsdp 2☆65Aug 8, 2025Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆279Oct 3, 2025Updated last year
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆155Oct 6, 2026Updated last week
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated 5 months ago
- ☆40Jul 26, 2024Updated 2 years ago