Scalable and Performant Data Loading
☆380Apr 11, 2026Updated this week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆491Apr 3, 2026Updated last week
- ☆21Mar 3, 2025Updated last year
- Hacks for PyTorch☆19Apr 18, 2023Updated 2 years ago
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,041Feb 9, 2026Updated 2 months ago
- Schedule-Free Optimization in PyTorch☆2,271May 21, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- PyTorch media decoding and encoding☆1,040Apr 6, 2026Updated last week
- A PyTorch native platform for training generative AI models☆5,220Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆284Nov 24, 2025Updated 4 months ago
- Helpful tools and examples for working with flex-attention☆1,167Apr 1, 2026Updated last week
- Prototype routines for GPU quantization written using PyTorch.☆21Updated this week
- TORCH_TRACE parser for PT2☆84Updated this week
- FAIR Sequence Modeling Toolkit 2☆1,128Updated this week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated last year
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A toolkit for scaling law research ⚖☆60Jan 27, 2025Updated last year
- Latent Large Language Models☆19Aug 24, 2024Updated last year
- [NeurIPS 2023] and [ICLR 2024] for robustness certification.☆10Nov 30, 2024Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆272Oct 3, 2025Updated 6 months ago
- TensorDict is a pytorch dedicated tensor container.☆1,019Updated this week
- ☆18Mar 18, 2024Updated 2 years ago
- PyTorch native quantization and sparsity for training and inference☆2,769Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆599Aug 12, 2025Updated 8 months ago
- Whisper finetuning☆16Apr 9, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,757Jul 18, 2025Updated 8 months ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,990Jun 16, 2024Updated last year
- Muon fsdp 2☆56Aug 8, 2025Updated 8 months ago
- New implementations of old orthogonal layers unlock large scale training.☆30Sep 19, 2025Updated 6 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆251Jun 6, 2025Updated 10 months ago
- Minimalistic large language model 3D-parallelism training☆2,644Updated this week
- experiments about AudioSet☆43Jul 22, 2023Updated 2 years ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆375Dec 12, 2024Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆205Jul 17, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- For optimization algorithm research and development.☆562Mar 19, 2026Updated 3 weeks ago
- Efficient Triton Kernels for LLM Training☆6,265Updated this week
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆343Apr 6, 2026Updated last week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,254Updated this week
- Distributed Compiler based on Triton for Parallel Systems☆1,403Updated this week
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!☆2,242Mar 12, 2026Updated last month
- ☆124May 28, 2024Updated last year