This module defines a type system for distributed training code, based off of JAX's sharding in types, but adapted for the PyTorch ecosystem.
☆36Aug 26, 2026Updated this week
Alternatives and similar repositories for spmd_types
Users that are interested in spmd_types are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.☆96Aug 16, 2026Updated last week
- Communication patterns for AI, built on top of NCCL device and host APIs☆41Updated this week
- torchcomms: a modern PyTorch communications API☆390Updated this week
- SpecTrax is a JAX-native library for neural networks and graph learning, built for performance, composability and modularity.☆43Aug 15, 2026Updated 2 weeks ago
- Implementation of FixMatch in PyTorch and experimentations☆12Aug 9, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- UW-Madison Course Monitor☆10Oct 4, 2019Updated 6 years ago
- Conveniently export torch.compile compiled products into self-contained Python files☆34Jun 5, 2026Updated 2 months ago
- A differentiable, self-modifying esolang where gradient descent is an instruction and programs rewrite their own parameters, designed by …☆38Updated this week
- Vine: The BitBlaze Static Analysis Component☆26Sep 27, 2014Updated 11 years ago
- My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.☆42Apr 30, 2026Updated 3 months ago
- Standalone commandline CLI tool for compiling Triton kernels☆20Sep 13, 2024Updated last year
- GPU Affinity is a package to automatically set the CPU process affinity to match the hardware architecture on a given platform☆29Dec 8, 2023Updated 2 years ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆533Updated this week
- Framework for Algorithmic Correctness Testing of Operators☆16Mar 9, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- SIMD quantization kernels☆93May 29, 2026Updated 2 months ago
- ☆21Aug 18, 2022Updated 4 years ago
- Autonomous GPU Kernel Generation & Optimization via Deep Agents☆532Jul 15, 2026Updated last month
- Make triton easier☆49Jun 12, 2024Updated 2 years ago
- Tutorials for NVIDIA CUPTI samples☆72Jul 22, 2026Updated last month
- Compact and Agent-Native MoE Training System☆343Aug 22, 2026Updated last week
- A synthetic story narration dataset to study small audio LMs.☆31Jan 21, 2024Updated 2 years ago
- My study note for mlsys☆15Nov 4, 2024Updated last year
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆83Aug 13, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Reference implementation for "Group Equivariant Subsampling"☆17Dec 13, 2021Updated 4 years ago
- OpenPAI SDK☆19Dec 10, 2022Updated 3 years ago
- ☆85Dec 2, 2022Updated 3 years ago
- A codebase for pretraining multi-billion-scale sparse GPTs.☆28Feb 9, 2026Updated 6 months ago
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated 5 months ago
- isla coq infrastructure☆22Mar 11, 2025Updated last year
- EmojiNotion – project for CBMI 2025 conference☆14Jun 6, 2025Updated last year
- Simple RPC in C++, with Python binding☆27Apr 24, 2015Updated 11 years ago
- Nsight Python is a Python kernel profiling interface based on NVIDIA Nsight Tools☆288Aug 17, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Backprop with Low-Precision Activations☆11Oct 28, 2019Updated 6 years ago
- 在线图书借阅系统 - 2017 THU OOP课大作业☆14Jul 1, 2018Updated 8 years ago
- Developer blog for PyTorch☆20Updated this week
- ☆76Dec 10, 2025Updated 8 months ago
- Infiniband verbs performance tests (fork of git://git.openfabrics.org/~grockah/perftest.git)☆21Jan 14, 2016Updated 10 years ago
- torchprime is a reference model implementation for PyTorch on TPU.☆49Mar 3, 2026Updated 5 months ago
- library which simplifies host-GPU data transfer using userspace pagefault handling☆15Jun 8, 2012Updated 14 years ago