Scalable and Performant Data Loading
☆390Jun 4, 2026Updated last week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆511Updated this week
- ☆21Mar 3, 2025Updated last year
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,114Feb 9, 2026Updated 4 months ago
- Schedule-Free Optimization in PyTorch☆2,299May 18, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PyTorch media decoding and encoding☆1,082Updated this week
- A PyTorch native platform for training generative AI models☆5,416Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆286Nov 24, 2025Updated 6 months ago
- Helpful tools and examples for working with flex-attention☆1,195May 28, 2026Updated 2 weeks ago
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated last month
- TORCH_TRACE parser for PT2☆86May 11, 2026Updated last month
- FAIR Sequence Modeling Toolkit 2☆1,137Jun 4, 2026Updated last week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Latent Large Language Models☆19Aug 24, 2024Updated last year
- A toolkit for scaling law research ⚖☆64Jan 27, 2025Updated last year
- [NeurIPS 2023] and [ICLR 2024] for robustness certification.☆10Nov 30, 2024Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆278Oct 3, 2025Updated 8 months ago
- PyTorch native quantization and sparsity for training and inference☆2,847Jun 5, 2026Updated last week
- TensorDict is a pytorch dedicated tensor container.☆1,029Jun 5, 2026Updated last week
- ☆18Mar 18, 2024Updated 2 years ago
- Whisper finetuning☆17Apr 9, 2025Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆600May 13, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,763Jul 18, 2025Updated 10 months ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,989Jun 16, 2024Updated last year
- Muon fsdp 2☆59Aug 8, 2025Updated 10 months ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,254Updated this week
- New implementations of old orthogonal layers unlock large scale training.☆31Sep 19, 2025Updated 8 months ago
- experiments about AudioSet☆43Jul 22, 2023Updated 2 years ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆255Jun 6, 2025Updated last year
- Minimalistic large language model 3D-parallelism training☆2,711May 26, 2026Updated 2 weeks ago
- Efficient Triton Kernels for LLM Training☆6,415Jun 5, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆377Dec 12, 2024Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆205Jul 17, 2024Updated last year
- For optimization algorithm research and development.☆573May 6, 2026Updated last month
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆345Jun 1, 2026Updated last week
- ☆125May 28, 2024Updated 2 years ago
- Distributed Compiler based on Triton for Parallel Systems☆1,455Apr 22, 2026Updated last month
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!☆2,295Apr 13, 2026Updated last month