deepspeedai / DeepSpeed-KernelsLinks
☆72Updated 6 months ago
Alternatives and similar repositories for DeepSpeed-Kernels
Users that are interested in DeepSpeed-Kernels are comparing it to the libraries listed below
Sorting:
- Framework to reduce autotune overhead to zero for well known deployments.☆84Updated last month
- ☆112Updated last year
- A Python library transfers PyTorch tensors between CPU and NVMe☆120Updated 10 months ago
- ☆101Updated 5 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆83Updated last year
- extensible collectives library in triton☆89Updated 6 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆125Updated 4 months ago
- ☆96Updated 6 months ago
- ☆92Updated 11 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆116Updated last year
- ☆121Updated last year
- Odysseus: Playground of LLM Sequence Parallelism☆78Updated last year
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆265Updated 3 months ago
- GPTQ inference TVM kernel☆39Updated last year
- ☆51Updated this week
- ☆65Updated 5 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆112Updated last year
- Benchmark code for the "Online normalizer calculation for softmax" paper☆101Updated 7 years ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆130Updated 10 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆100Updated 3 months ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆50Updated last year
- A safetensors extension to efficiently store sparse quantized tensors on disk☆180Updated this week
- Ahead of Time (AOT) Triton Math Library☆79Updated last week
- DeeperGEMM: crazy optimized version☆72Updated 5 months ago
- ☆158Updated 2 years ago
- llama INT4 cuda inference with AWQ☆55Updated 9 months ago
- ☆205Updated 5 months ago
- Applied AI experiments and examples for PyTorch☆299Updated 2 months ago
- ☆78Updated 10 months ago
- ☆100Updated last year