meta-pytorch / BackendBenchLinks
Ship correct and fast LLM kernels to PyTorch
☆126Updated this week
Alternatives and similar repositories for BackendBench
Users that are interested in BackendBench are comparing it to the libraries listed below
Sorting:
- extensible collectives library in triton☆91Updated 8 months ago
- Triton-based Symmetric Memory operators and examples☆67Updated 2 months ago
- ring-attention experiments☆160Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆64Updated last week
- ☆263Updated this week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆301Updated this week
- Accelerating MoE with IO and Tile-aware Optimizations☆351Updated this week
- Nsight Python is a Python kernel profiling interface based on NVIDIA Nsight Tools☆77Updated this week
- Collection of kernels written in Triton language☆172Updated 8 months ago
- Autonomous GPU Kernel Generation via Deep Agents☆187Updated this week
- ☆99Updated last year
- TPU inference for vLLM, with unified JAX and PyTorch support.☆199Updated this week
- A bunch of kernels that might make stuff slower 😉☆69Updated this week
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆148Updated last month
- Applied AI experiments and examples for PyTorch☆311Updated 4 months ago
- Fast low-bit matmul kernels in Triton☆410Updated this week
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆140Updated this week
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆61Updated this week
- Framework to reduce autotune overhead to zero for well known deployments.☆90Updated 3 months ago
- Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…☆86Updated last month
- PyTorch bindings for CUTLASS grouped GEMM.☆135Updated 6 months ago
- DeeperGEMM: crazy optimized version☆73Updated 7 months ago
- Github mirror of trition-lang/triton repo.☆109Updated this week
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆178Updated this week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆415Updated last month
- Triton-based implementation of Sparse Mixture of Experts.☆257Updated 2 months ago
- JAX backend for SGL☆200Updated this week
- Helpful kernel tutorials and examples for tile-based GPU programming☆456Updated this week
- Cataloging released Triton kernels.☆278Updated 3 months ago
- ☆115Updated last year