This module defines a type system for distributed training code, based off of JAX's sharding in types, but adapted for the PyTorch ecosystem.
☆35Jul 27, 2026Updated last week
Alternatives and similar repositories for spmd_types
Users that are interested in spmd_types are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Communication patterns for AI, built on top of NCCL device and host APIs☆25Updated this week
- torchcomms: a modern PyTorch communications API☆383Updated this week
- SpecTrax is a JAX-native library for neural networks and graph learning, built for performance, composability and modularity.☆43Jul 13, 2026Updated 3 weeks ago
- ☆17Apr 1, 2020Updated 6 years ago
- Conveniently export torch.compile compiled products into self-contained Python files☆35Jun 5, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- gradient-based symbolic execution engine implemented from scratch☆38Dec 16, 2023Updated 2 years ago
- My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.☆40Apr 30, 2026Updated 3 months ago
- Standalone commandline CLI tool for compiling Triton kernels☆20Sep 13, 2024Updated last year
- GPU Affinity is a package to automatically set the CPU process affinity to match the hardware architecture on a given platform☆29Dec 8, 2023Updated 2 years ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆529Jul 16, 2026Updated 2 weeks ago
- Framework for Algorithmic Correctness Testing of Operators☆16Mar 9, 2026Updated 4 months ago
- SIMD quantization kernels☆93May 29, 2026Updated 2 months ago
- ☆21Aug 18, 2022Updated 3 years ago
- Autonomous GPU Kernel Generation & Optimization via Deep Agents☆494Jul 15, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Make triton easier☆49Jun 12, 2024Updated 2 years ago
- PyTorch Single Controller☆1,066Updated this week
- Automatically insert nvtx ranges to PyTorch models☆22Apr 28, 2021Updated 5 years ago
- Tutorials for NVIDIA CUPTI samples☆71Jul 22, 2026Updated last week
- Compact and Agent-Native MoE Training System☆314Updated this week
- A synthetic story narration dataset to study small audio LMs.☆31Jan 21, 2024Updated 2 years ago
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆82Jun 18, 2026Updated last month
- ☆10Sep 4, 2021Updated 4 years ago
- Reference implementation for "Group Equivariant Subsampling"☆16Dec 13, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆85Dec 2, 2022Updated 3 years ago
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated 4 months ago
- Official repository for the paper "GN-Transformer: Fusing AST and Source Code information in Graph Networks".☆17May 25, 2025Updated last year
- Companion website of "MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform", accepted at ICSE 23☆10Mar 12, 2025Updated last year
- Nsight Python is a Python kernel profiling interface based on NVIDIA Nsight Tools☆285Updated this week
- ☆16Apr 11, 2024Updated 2 years ago
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆212Updated this week
- 在线图书借阅系统 - 2017 THU OOP课大作业☆14Jul 1, 2018Updated 8 years ago
- Developer blog for PyTorch☆20Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆74Dec 10, 2025Updated 7 months ago
- JAX support for tvm-ffi abi☆26May 14, 2026Updated 2 months ago
- Infiniband verbs performance tests (fork of git://git.openfabrics.org/~grockah/perftest.git)☆21Jan 14, 2016Updated 10 years ago
- ☆171Dec 27, 2024Updated last year
- Three-Dimensional Mixed-Element Unstructured Finite-Volume Solver for Compressible Euler/Navier-Stokes Equations☆27Feb 1, 2016Updated 10 years ago
- ☆14Jun 26, 2024Updated 2 years ago
- 3D Navier-Stokes Local Discontinuous Galerkin Solver☆19Sep 7, 2018Updated 7 years ago