NVIDIA / jaxppLinks
JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
☆49Updated last month
Alternatives and similar repositories for jaxpp
Users that are interested in jaxpp are comparing it to the libraries listed below
Sorting:
- extensible collectives library in triton☆86Updated 2 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆170Updated this week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆167Updated this week
- TritonParse is a tool designed to help developers analyze and debug Triton kernels by visualizing the compilation process and source code…☆93Updated last week
- A Quirky Assortment of CuTe Kernels☆117Updated this week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆90Updated 3 weeks ago
- ☆90Updated 6 months ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated 10 months ago
- Applied AI experiments and examples for PyTorch☆277Updated 3 weeks ago
- PyTorch bindings for CUTLASS grouped GEMM.☆100Updated 3 weeks ago
- ☆81Updated 7 months ago
- ☆109Updated 3 months ago
- ☆50Updated last year
- ☆212Updated 11 months ago
- DeeperGEMM: crazy optimized version☆69Updated last month
- ☆35Updated last month
- ☆167Updated last year
- ☆221Updated this week
- ☆71Updated last month
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆109Updated 11 months ago
- ☆60Updated 2 months ago
- A bunch of kernels that might make stuff slower 😉☆51Updated this week
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- ring-attention experiments☆144Updated 8 months ago
- Cataloging released Triton kernels.☆238Updated 5 months ago
- ☆28Updated 5 months ago
- MLIR-based partitioning system☆97Updated this week
- Collection of kernels written in Triton language☆132Updated 2 months ago
- ☆105Updated 10 months ago
- PyTorch centric eager mode debugger☆47Updated 6 months ago