Alternatives and similar repositories for mirage:

Users that are interested in mirage are comparing it to the libraries listed below

• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆699Updated last month
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆514Updated this week
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆523Updated last week
• mit-han-lab / qserve
  QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
  ☆496Updated this week
• siboehm / SGEMM_CUDA
  Fast CUDA matrix multiplication from scratch
  ☆634Updated last year
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆2,078Updated this week
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆420Updated this week
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆2,042Updated this week
• IST-DASLab / marlin
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆729Updated 5 months ago
• thuml / depyf
  depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.
  ☆582Updated 2 months ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆260Updated last month
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆225Updated this week
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆296Updated 3 months ago
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆674Updated 2 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆316Updated 5 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆236Updated this week
• efeslab / Nanoflow
  A throughput-oriented high-performance serving framework for LLMs
  ☆737Updated 5 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆229Updated 2 months ago
• wangzyon / NVIDIA_SGEMM_PRACTICE
  Step-by-step optimization of CUDA SGEMM
  ☆284Updated 2 years ago
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆290Updated this week
• pranjalssh / fast.cu
  Fastest kernels written from scratch
  ☆170Updated this week
• spcl / QuaRot
  Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.
  ☆342Updated 2 months ago
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆237Updated 8 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆179Updated last week
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆397Updated this week
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆229Updated this week
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,403Updated 3 months ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆345Updated 5 months ago
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆567Updated 4 months ago