Kernels, of the mega variety :)
☆817May 26, 2026Updated 3 months ago
Alternatives and similar repositories for Megakernels
Users that are interested in Megakernels are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆2,466Updated this week
- Tile primitives for speedy kernels☆3,660Updated this week
- A Quirky Assortment of CuTe Kernels☆1,135Updated this week
- Distributed Compiler and Optimized Parallel Kernels☆1,530Aug 12, 2026Updated 3 weeks ago
- ☆65Apr 26, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Accelerating MoE with IO and Tile-aware Optimizations☆753Updated this week
- A lightweight design for computation-communication overlap.☆245Jan 20, 2026Updated 7 months ago
- FlashInfer: Kernel Library for LLM Serving☆6,318Updated this week
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,358Aug 28, 2025Updated last year
- Distributed MoE in a Single Kernel [NeurIPS '25]☆288May 5, 2026Updated 3 months ago
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆7,328Updated this week
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆930Updated this week
- Perplexity GPU Kernels☆604Nov 7, 2025Updated 9 months ago
- mKernel: fast multi-node, multi-GPU fused kernels☆270Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Fast and Memory-Efficient Exact Attention (BF16/FP16/FP8/FP4) for Large Headdim, 1.5x~15x speedup over PyTorch SDPA.☆331Updated this week
- ☆54May 19, 2025Updated last year
- ☆200Aug 9, 2026Updated 3 weeks ago
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆490Aug 17, 2026Updated 2 weeks ago
- DeepGEMM: clean and efficient BLAS kernel library on GPU☆7,768Updated this week
- FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.☆1,138Sep 4, 2024Updated last year
- Open ABI and FFI for Machine Learning Systems☆455Updated this week
- ☆172Dec 27, 2024Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 🚀 Efficient implementations for emerging model architectures☆5,682Updated this week
- Github mirror of trition-lang/triton repo.☆195Updated this week
- ☆253Nov 19, 2025Updated 9 months ago
- a size profiler for cuda binary☆71Jan 15, 2026Updated 7 months ago
- ☆32Jul 2, 2025Updated last year
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆10,362Updated this week
- ☆125May 19, 2025Updated last year
- Dynamic Memory Management for Serving LLMs without PagedAttention☆519Aug 24, 2026Updated last week
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,747Aug 13, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,227Mar 24, 2026Updated 5 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆117Aug 4, 2026Updated 3 weeks ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆277May 1, 2026Updated 4 months ago
- cuTile is a programming model for writing parallel kernels for NVIDIA GPUs☆2,138Updated this week
- High-performance LLM operator library built on TileLang.☆176Updated this week
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training☆936Updated this week
- Helpful kernel tutorials, examples and SKILLs for tile-based GPU programming☆807Updated this week