ScalingIntelligence / good-kernelsLinks
Samples of good AI generated CUDA kernels
☆83Updated 3 weeks ago
Alternatives and similar repositories for good-kernels
Users that are interested in good-kernels are comparing it to the libraries listed below
Sorting:
- RWKV-7: Surpassing GPT☆91Updated 7 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆126Updated 6 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆46Updated this week
- ☆133Updated 2 months ago
- LLM Inference on consumer devices☆119Updated 3 months ago
- ☆65Updated 2 weeks ago
- High-Performance SGEMM on CUDA devices☆95Updated 5 months ago
- TritonParse is a tool designed to help developers analyze and debug Triton kernels by visualizing the compilation process and source code…☆93Updated this week
- Learn CUDA with PyTorch☆27Updated this week
- [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration☆213Updated 7 months ago
- extensible collectives library in triton☆86Updated 2 months ago
- Personal solutions to the Triton Puzzles☆19Updated 11 months ago
- Simple high-throughput inference library☆119Updated last month
- QuIP quantization☆54Updated last year
- ☆48Updated 11 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆79Updated 9 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆67Updated 3 months ago
- ☆56Updated 3 months ago
- Make triton easier☆46Updated last year
- PyTorch implementation of models from the Zamba2 series.☆182Updated 5 months ago
- ☆213Updated 5 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 11 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆126Updated this week
- Work in progress.☆69Updated 2 weeks ago
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆71Updated 4 months ago
- Fast and memory-efficient exact attention☆68Updated 3 months ago
- Token Omission Via Attention☆127Updated 8 months ago
- ring-attention experiments☆144Updated 8 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆78Updated last month
- Repository for CPU Kernel Generation for LLM Inference☆26Updated last year