flagos-ai / awesome-LLM-driven-kernel-generationLinks
Review automated kernel generation in the era of LLMs
☆91Updated 2 weeks ago
Alternatives and similar repositories for awesome-LLM-driven-kernel-generation
Users that are interested in awesome-LLM-driven-kernel-generation are comparing it to the libraries listed below
Sorting:
- ☆155Updated 11 months ago
- A simple calculation for LLM MFU.☆66Updated 5 months ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆151Updated last week
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆191Updated last week
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆147Updated last month
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆87Updated 2 months ago
- ☆47Updated last year
- [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference☆372Updated 7 months ago
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆313Updated 8 months ago
- TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators☆114Updated 7 months ago
- Autonomous GPU Kernel Generation via Deep Agents☆228Updated this week
- High-performance distributed data shuffling (all-to-all) library for MoE training and inference☆112Updated last month
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆83Updated 5 months ago
- Learning TileLang with 10 puzzles!☆118Updated last week
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆101Updated last month
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆66Updated 2 months ago
- Allow torch tensor memory to be released and resumed later☆216Updated 3 weeks ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆191Updated this week
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆80Updated last month
- Keyformer proposes KV Cache reduction through key tokens identification and without the need for fine-tuning☆58Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆142Updated 8 months ago
- ☆130Updated 5 months ago
- nnScaler: Compiling DNN models for Parallel Training☆124Updated 4 months ago
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆160Updated 3 months ago
- 16-fold memory access reduction with nearly no loss☆110Updated 10 months ago
- A lightweight design for computation-communication overlap.☆219Updated 3 weeks ago
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆283Updated 11 months ago
- FlashInfer Bench @ MLSys 2026: Building AI agents to write high performance GPU kernels☆84Updated 2 weeks ago
- NVIDIA cuTile learn☆158Updated 2 months ago
- Nex Venus Communication Library☆72Updated 2 months ago