Scalable and Performant Data Loading
☆397Sep 21, 2026Updated this week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆540Updated this week
- Media decoding and encoding for PyTorch: videos, images, and audio, on CPU and GPU.☆1,171Updated this week
- A PyTorch native platform for training generative AI models☆5,757Updated this week
- PyTorch Single Controller☆1,076Updated this week
- Schedule-Free Optimization in PyTorch☆2,323Jul 28, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆21Mar 3, 2025Updated last year
- A Data Streaming Library for Efficient Neural Network Training☆1,561Jun 25, 2026Updated 2 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆288Nov 24, 2025Updated 9 months ago
- Helpful tools and examples for working with flex-attention☆1,252Updated this week
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- PyTorch native quantization for training and inference☆2,983Updated this week
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Framework for Algorithmic Correctness Testing of Operators☆17Mar 9, 2026Updated 6 months ago
- FAIR Sequence Modeling Toolkit 2☆1,151Sep 8, 2026Updated 2 weeks ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆434Aug 5, 2026Updated last month
- Efficient Triton Kernels for LLM Training☆6,627Updated this week
- TensorDict is a pytorch dedicated tensor container.☆1,035Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,267Updated this week
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Nov 19, 2024Updated last year
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆1,005Sep 15, 2026Updated last week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆369Updated this week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- torchcomms: a modern PyTorch communications API☆397Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Applied AI experiments and examples for PyTorch☆322Aug 22, 2025Updated last year
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆950Updated this week
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,992Jun 16, 2024Updated 2 years ago
- Library for reading and processing ML training data.☆782Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,549Updated this week
- A Quirky Assortment of CuTe Kernels☆1,151Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆387Dec 12, 2024Updated last year
- Tile primitives for speedy kernels☆3,724Sep 12, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Distributed Compiler and Optimized Parallel Kernels☆1,549Updated this week
- Muon fsdp 2☆65Aug 8, 2025Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆280Oct 3, 2025Updated 11 months ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆154Updated this week
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated 5 months ago
- ☆40Jul 26, 2024Updated 2 years ago
- Framework to reduce autotune overhead to zero for well known deployments.☆101Sep 19, 2025Updated last year