Scalable and Performant Data Loading
☆394Jul 24, 2026Updated this week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆526Jul 16, 2026Updated last week
- PyTorch media decoding and encoding☆1,148Updated this week
- A PyTorch native platform for training generative AI models☆5,556Updated this week
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,148Feb 9, 2026Updated 5 months ago
- PyTorch Single Controller☆1,060Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Schedule-Free Optimization in PyTorch☆2,317Jun 18, 2026Updated last month
- ☆21Mar 3, 2025Updated last year
- A Data Streaming Library for Efficient Neural Network Training☆1,536Jun 25, 2026Updated 3 weeks ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆288Nov 24, 2025Updated 8 months ago
- Helpful tools and examples for working with flex-attention☆1,211Updated this week
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- PyTorch native quantization and sparsity for training and inference☆2,912Updated this week
- Latent Large Language Models☆19Aug 24, 2024Updated last year
- Framework for Algorithmic Correctness Testing of Operators☆16Mar 9, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- FAIR Sequence Modeling Toolkit 2☆1,142Updated this week
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆428Updated this week
- Efficient Triton Kernels for LLM Training☆6,533Updated this week
- TensorDict is a pytorch dedicated tensor container.☆1,034Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,258Updated this week
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Nov 19, 2024Updated last year
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆980Jul 4, 2026Updated 2 weeks ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆362Updated this week
- torchcomms: a modern PyTorch communications API☆380Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- Applied AI experiments and examples for PyTorch☆321Aug 22, 2025Updated 11 months ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated 11 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆914Updated this week
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,991Jun 16, 2024Updated 2 years ago
- Library for reading and processing ML training data.☆754Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,446Updated this week
- A Quirky Assortment of CuTe Kernels☆1,070Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆379Dec 12, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Tile primitives for speedy kernels☆3,563Jul 13, 2026Updated last week
- Distributed Compiler based on Triton for Parallel Systems☆1,498Updated this week
- Muon fsdp 2☆64Aug 8, 2025Updated 11 months ago
- Triton-based implementation of Sparse Mixture of Experts.☆281Oct 3, 2025Updated 9 months ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆121Updated this week
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated 3 months ago
- ☆40Jul 26, 2024Updated last year