Scalable and Performant Data Loading
☆383May 1, 2026Updated this week
Alternatives and similar repositories for spdl
Users that are interested in spdl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆499Apr 3, 2026Updated last month
- ☆21Mar 3, 2025Updated last year
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,069Feb 9, 2026Updated 2 months ago
- Schedule-Free Optimization in PyTorch☆2,277May 21, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PyTorch media decoding and encoding☆1,056Updated this week
- A PyTorch native platform for training generative AI models☆5,286Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆285Nov 24, 2025Updated 5 months ago
- Helpful tools and examples for working with flex-attention☆1,179Apr 13, 2026Updated 2 weeks ago
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated 2 weeks ago
- TORCH_TRACE parser for PT2☆85Updated this week
- FAIR Sequence Modeling Toolkit 2☆1,128Updated this week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Latent Large Language Models☆19Aug 24, 2024Updated last year
- A toolkit for scaling law research ⚖☆62Jan 27, 2025Updated last year
- [NeurIPS 2023] and [ICLR 2024] for robustness certification.☆10Nov 30, 2024Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆273Oct 3, 2025Updated 7 months ago
- PyTorch native quantization and sparsity for training and inference☆2,807Updated this week
- TensorDict is a pytorch dedicated tensor container.☆1,022Updated this week
- ☆18Mar 18, 2024Updated 2 years ago
- Whisper finetuning☆16Apr 9, 2025Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆600Aug 12, 2025Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,762Jul 18, 2025Updated 9 months ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,990Jun 16, 2024Updated last year
- Muon fsdp 2☆56Aug 8, 2025Updated 8 months ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,256Updated this week
- New implementations of old orthogonal layers unlock large scale training.☆31Sep 19, 2025Updated 7 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆252Jun 6, 2025Updated 10 months ago
- experiments about AudioSet☆43Jul 22, 2023Updated 2 years ago
- Minimalistic large language model 3D-parallelism training☆2,674Apr 7, 2026Updated 3 weeks ago
- Efficient Triton Kernels for LLM Training☆6,315Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆375Dec 12, 2024Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆205Jul 17, 2024Updated last year
- For optimization algorithm research and development.☆565Apr 10, 2026Updated 3 weeks ago
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆344Updated this week
- Distributed Compiler based on Triton for Parallel Systems☆1,420Apr 22, 2026Updated last week
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!☆2,260Apr 13, 2026Updated 2 weeks ago
- ☆124May 28, 2024Updated last year