open-lm-engine / accelerated-model-architecturesLinks
A bunch of kernels that might make stuff slower 😉
☆73Updated last week
Alternatives and similar repositories for accelerated-model-architectures
Users that are interested in accelerated-model-architectures are comparing it to the libraries listed below
Sorting:
- extensible collectives library in triton☆92Updated 9 months ago
- Triton-based Symmetric Memory operators and examples☆74Updated this week
- ring-attention experiments☆161Updated last year
- ☆101Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆140Updated 7 months ago
- Cataloging released Triton kernels.☆287Updated 4 months ago
- ☆271Updated last week
- Collection of kernels written in Triton language☆174Updated 9 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆92Updated 3 months ago
- ☆115Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆260Updated 3 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆91Updated last year
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆310Updated this week
- Autonomous GPU Kernel Generation via Deep Agents☆211Updated this week
- Ship correct and fast LLM kernels to PyTorch☆132Updated this week
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆159Updated 2 months ago
- Applied AI experiments and examples for PyTorch☆312Updated 4 months ago
- This repository contains the experimental PyTorch native float8 training UX☆227Updated last year
- Fast low-bit matmul kernels in Triton☆423Updated last month
- The simplest but fast implementation of matrix multiplication in CUDA.☆39Updated last year
- Explore training for quantized models☆26Updated 6 months ago
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆62Updated last week
- ☆39Updated last month
- Accelerating MoE with IO and Tile-aware Optimizations☆542Updated this week
- ☆132Updated 7 months ago
- Automatic differentiation for Triton Kernels☆29Updated 5 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆124Updated last year
- Transformers components but in Triton☆34Updated 8 months ago
- Personal solutions to the Triton Puzzles☆20Updated last year
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆247Updated 8 months ago