Alternatives and similar repositories for mirage:

Users that are interested in mirage are comparing it to the libraries listed below

• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆505Updated 2 months ago
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆496Updated this week
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆681Updated 2 weeks ago
• mit-han-lab / qserve
  QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
  ☆481Updated 2 months ago
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆1,797Updated this week
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆397Updated this week
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,923Updated this week
• siboehm / SGEMM_CUDA
  Fast CUDA matrix multiplication from scratch
  ☆579Updated last year
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆645Updated 3 weeks ago
• thuml / depyf
  depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.
  ☆550Updated last month
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆271Updated 2 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆306Updated 3 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆211Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆170Updated this week
• spcl / QuaRot
  Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.
  ☆315Updated last month
• IST-DASLab / marlin
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆680Updated 4 months ago
• wangzyon / NVIDIA_SGEMM_PRACTICE
  Step-by-step optimization of CUDA SGEMM
  ☆270Updated 2 years ago
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆549Updated 3 months ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆330Updated 4 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆219Updated last week
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆272Updated last month
• efeslab / Nanoflow
  A throughput-oriented high-performance serving framework for LLMs
  ☆692Updated 3 months ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆244Updated 2 weeks ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆219Updated 5 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆199Updated last month
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆736Updated 4 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆344Updated 2 weeks ago
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆229Updated 7 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆187Updated last week
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆400Updated 2 weeks ago