zeux / calmLinks
CUDA/Metal accelerated language model inference
☆625Updated 7 months ago
Alternatives and similar repositories for calm
Users that are interested in calm are comparing it to the libraries listed below
Sorting:
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆546Updated 3 months ago
- kernels, of the mega variety☆640Updated 3 months ago
- Fastest kernels written from scratch☆517Updated 3 months ago
- Perplexity GPU Kernels☆548Updated 2 months ago
- Fast low-bit matmul kernels in Triton☆418Updated 3 weeks ago
- Flash Attention in ~100 lines of CUDA (forward pass only)☆1,040Updated last year
- Applied AI experiments and examples for PyTorch☆312Updated 4 months ago
- High-Performance SGEMM on CUDA devices☆115Updated 11 months ago
- BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.☆738Updated 5 months ago
- A Quirky Assortment of CuTe Kernels☆741Updated this week
- ☆270Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆590Updated 4 months ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆182Updated 2 weeks ago
- [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…☆801Updated 10 months ago
- FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.☆978Updated last year
- A throughput-oriented high-performance serving framework for LLMs☆936Updated 2 months ago
- AI Tensor Engine for ROCm☆330Updated this week
- Cataloging released Triton kernels.☆282Updated 4 months ago
- ☆127Updated 2 months ago
- Multi-Threaded FP32 Matrix Multiplication on x86 CPUs☆372Updated 8 months ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆276Updated 5 months ago
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆437Updated 3 weeks ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆246Updated 8 months ago
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆2,032Updated 2 weeks ago
- Materials for learning SGLang☆714Updated this week
- Fast CUDA matrix multiplication from scratch☆1,004Updated 4 months ago
- Helpful kernel tutorials and examples for tile-based GPU programming☆554Updated this week
- Step by step implementation of a fast softmax kernel in CUDA☆59Updated last year
- Awesome resources for GPUs☆605Updated 2 years ago
- Learning about CUDA by writing PTX code.☆151Updated last year