NVIDIA / jaxpp
JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
☆43Updated this week
Alternatives and similar repositories for jaxpp
Users that are interested in jaxpp are comparing it to the libraries listed below
Sorting:
- extensible collectives library in triton☆86Updated last month
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆132Updated this week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆124Updated this week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆85Updated this week
- ☆79Updated 6 months ago
- ☆27Updated 4 months ago
- DeeperGEMM: crazy optimized version☆69Updated last week
- ☆204Updated 3 weeks ago
- PyTorch bindings for CUTLASS grouped GEMM.☆89Updated 2 weeks ago
- Framework to reduce autotune overhead to zero for well known deployments.☆70Updated this week
- Experiment of using Tangent to autodiff triton☆78Updated last year
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- ☆50Updated last year
- A bunch of kernels that might make stuff slower 😉☆40Updated this week
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆109Updated 10 months ago
- FlexAttention w/ FlashAttention3 Support☆26Updated 7 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 10 months ago
- ☆104Updated 8 months ago
- Applied AI experiments and examples for PyTorch☆267Updated this week
- Ahead of Time (AOT) Triton Math Library☆63Updated this week
- Collection of kernels written in Triton language☆122Updated last month
- This repository contains the experimental PyTorch native float8 training UX☆224Updated 9 months ago
- ☆70Updated last week
- ☆33Updated this week
- ☆202Updated 10 months ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆42Updated 2 months ago
- ☆58Updated 3 weeks ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆73Updated 8 months ago
- ☆102Updated 2 months ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆78Updated 5 months ago