vedantroy / gpu_kernelsLinks
☆27Updated 2 years ago
Alternatives and similar repositories for gpu_kernels
Users that are interested in gpu_kernels are comparing it to the libraries listed below
Sorting:
- Framework to reduce autotune overhead to zero for well known deployments.☆92Updated 4 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆91Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆140Updated 7 months ago
- ☆115Updated last year
- QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference☆118Updated last year
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆124Updated last year
- ☆101Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆104Updated 6 months ago
- extensible collectives library in triton☆92Updated 9 months ago
- ☆71Updated 9 months ago
- llama INT4 cuda inference with AWQ☆55Updated last year
- ☆160Updated 2 years ago
- ☆117Updated 8 months ago
- ☆85Updated 11 months ago
- Triton-based Symmetric Memory operators and examples☆74Updated this week
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆161Updated 2 months ago
- Collection of kernels written in Triton language☆174Updated 9 months ago
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆175Updated last year
- ☆52Updated 8 months ago
- Autonomous GPU Kernel Generation via Deep Agents☆211Updated this week
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆46Updated 7 months ago
- ring-attention experiments☆161Updated last year
- ☆271Updated last week
- Quantized Attention on GPU☆44Updated last year
- DeeperGEMM: crazy optimized version☆73Updated 8 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆310Updated this week
- ☆96Updated 9 months ago
- ☆132Updated 7 months ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆276Updated 6 months ago
- ☆65Updated 8 months ago