NVIDIA / jaxppLinks
JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
☆54Updated this week
Alternatives and similar repositories for jaxpp
Users that are interested in jaxpp are comparing it to the libraries listed below
Sorting:
- extensible collectives library in triton☆88Updated 6 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆328Updated this week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆230Updated last week
- ☆242Updated this week
- ☆90Updated 11 months ago
- TritonParse: A Compiler Tracer, Visualizer, and mini-Reproducer for Triton Kernels☆152Updated this week
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- Applied AI experiments and examples for PyTorch☆296Updated last month
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆213Updated last week
- Fast low-bit matmul kernels in Triton☆376Updated last week
- A library to analyze PyTorch traces.☆415Updated this week
- A bunch of kernels that might make stuff slower 😉☆59Updated this week
- Cataloging released Triton kernels.☆261Updated last month
- A Quirky Assortment of CuTe Kernels☆603Updated last week
- Collection of kernels written in Triton language☆157Updated 6 months ago
- ☆121Updated 9 months ago
- How to ensure correctness and ship LLM generated kernels in PyTorch☆66Updated this week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆97Updated 3 months ago
- ☆331Updated 3 weeks ago
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆328Updated 3 weeks ago
- Ahead of Time (AOT) Triton Math Library☆77Updated this week
- ☆119Updated 6 months ago
- ☆238Updated last year
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated 2 weeks ago
- ☆113Updated last year
- ring-attention experiments☆152Updated 11 months ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆111Updated last week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆414Updated last week
- PyTorch bindings for CUTLASS grouped GEMM.☆123Updated 4 months ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆97Updated last week