open-lm-engine / accelerated-model-architecturesLinks
A bunch of kernels that might make stuff slower 😉
☆65Updated this week
Alternatives and similar repositories for accelerated-model-architectures
Users that are interested in accelerated-model-architectures are comparing it to the libraries listed below
Sorting:
- extensible collectives library in triton☆91Updated 8 months ago
- ☆94Updated last year
- Collection of kernels written in Triton language☆172Updated 8 months ago
- ring-attention experiments☆160Updated last year
- Applied AI experiments and examples for PyTorch☆308Updated 3 months ago
- ☆257Updated this week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆297Updated this week
- Cataloging released Triton kernels.☆274Updated 2 months ago
- Triton-based implementation of Sparse Mixture of Experts.☆253Updated 2 months ago
- Triton-based Symmetric Memory operators and examples☆65Updated last month
- Boosting 4-bit inference kernels with 2:4 Sparsity☆86Updated last year
- Fast low-bit matmul kernels in Triton☆402Updated 2 weeks ago
- PyTorch bindings for CUTLASS grouped GEMM.☆132Updated 6 months ago
- The simplest but fast implementation of matrix multiplication in CUDA.☆39Updated last year
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆143Updated 3 weeks ago
- Framework to reduce autotune overhead to zero for well known deployments.☆88Updated 2 months ago
- This repository contains the experimental PyTorch native float8 training UX☆226Updated last year
- Helpful kernel tutorials and examples for tile-based GPU programming☆202Updated this week
- ☆113Updated last year
- Ship correct and fast LLM kernels to PyTorch☆125Updated 3 weeks ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆123Updated last year
- ☆132Updated 6 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆216Updated 2 weeks ago
- ☆39Updated last week
- ☆23Updated 7 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆244Updated 7 months ago
- Autonomous GPU Kernel Generation via Deep Agents☆172Updated this week
- a minimal cache manager for PagedAttention, on top of llama3.☆126Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆102Updated 5 months ago
- ☆113Updated 6 months ago