Alternatives and similar repositories for FusedKernelLibrary

Users that are interested in FusedKernelLibrary are comparing it to the libraries listed below

• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆46Updated 6 months ago
• microsoft / AttentionEngine
  ☆114Updated 6 months ago
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆90Updated 2 months ago
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆70Updated last month
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆54Updated last month
• cherichy / tilecute
  ☆31Updated 5 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆44Updated last year
• huggingface / hf-rocm-kernels
  ☆22Updated 5 months ago
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆113Updated 10 months ago
• xdit-project / DiTCacheAnalysis
  An auxiliary project analysis of the characteristics of KV in DiT Attention.
  ☆32Updated last year
• AMD-AGI / GEAK-agent
  It is an LLM-based AI agent, which can write correct and efficient gpu kernels automatically.
  ☆47Updated this week
• meta-pytorch / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆47Updated 3 months ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆104Updated 5 months ago
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆108Updated last year
• tile-ai / AttentionEngine
  ☆52Updated 6 months ago
• mit-han-lab / tinychat-tutorial
  ☆76Updated last year
• vedantroy / gpu_kernels
  ☆27Updated last year
• NVIDIA / compute-eval
  Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…
  ☆84Updated 3 weeks ago
• RadeonFlow / RadeonFlow_Kernels
  Efficient implementation of DeepSeek Ops (Blockwise FP8 GEMM, MoE, and MLA) for AMD Instinct MI300X
  ☆73Updated 3 weeks ago
• ademeure / cuda-side-boost
  ☆52Updated 7 months ago
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆178Updated this week
• sandyresearch / chipmunk
  🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …
  ☆96Updated 3 months ago
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆41Updated last year
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 8 months ago
• meta-pytorch / BackendBench
  Ship correct and fast LLM kernels to PyTorch
  ☆126Updated this week
• flashinfer-ai / cubloaty
  a size profiler for cuda binary
  ☆66Updated 2 months ago
• thuml / learn_torch.compile
  torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile
  ☆18Updated last year
• SzymonOzog / Penny
  Hand-Rolled GPU communications library
  ☆73Updated 3 weeks ago
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆52Updated last year
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆302Updated this week