Scalable and Performant Data Loading
☆393Jun 28, 2026Updated this week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆515Jun 25, 2026Updated last week
- ☆21Mar 3, 2025Updated last year
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,125Feb 9, 2026Updated 4 months ago
- Schedule-Free Optimization in PyTorch☆2,307Jun 18, 2026Updated 2 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- PyTorch media decoding and encoding☆1,134Updated this week
- A PyTorch native platform for training generative AI models☆5,466Jun 26, 2026Updated last week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆288Nov 24, 2025Updated 7 months ago
- Helpful tools and examples for working with flex-attention☆1,205Updated this week
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated 2 months ago
- TORCH_TRACE parser for PT2☆87May 11, 2026Updated last month
- FAIR Sequence Modeling Toolkit 2☆1,141Jun 24, 2026Updated last week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A toolkit for scaling law research ⚖☆65Jan 27, 2025Updated last year
- Latent Large Language Models☆19Aug 24, 2024Updated last year
- [NeurIPS 2023] and [ICLR 2024] for robustness certification.☆10Nov 30, 2024Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆278Oct 3, 2025Updated 9 months ago
- PyTorch native quantization and sparsity for training and inference☆2,875Updated this week
- TensorDict is a pytorch dedicated tensor container.☆1,031Jun 25, 2026Updated last week
- ☆18Mar 18, 2024Updated 2 years ago
- Whisper finetuning☆17Apr 9, 2025Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆606May 13, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,761Jul 18, 2025Updated 11 months ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,988Jun 16, 2024Updated 2 years ago
- Muon fsdp 2☆62Aug 8, 2025Updated 10 months ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,255Jun 26, 2026Updated last week
- New implementations of old orthogonal layers unlock large scale training.☆31Sep 19, 2025Updated 9 months ago
- experiments about AudioSet☆43Jul 22, 2023Updated 2 years ago
- Minimalistic large language model 3D-parallelism training☆2,729May 26, 2026Updated last month
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆255Jun 6, 2025Updated last year
- Efficient Triton Kernels for LLM Training☆6,456Jun 23, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆378Dec 12, 2024Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆205Jul 17, 2024Updated last year
- For optimization algorithm research and development.☆577May 6, 2026Updated last month
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆347Jun 22, 2026Updated last week
- ☆124May 28, 2024Updated 2 years ago
- Distributed Compiler based on Triton for Parallel Systems☆1,466Jun 25, 2026Updated last week
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!☆2,306Apr 13, 2026Updated 2 months ago