Alternatives and similar repositories for calm:

Users that are interested in calm are comparing it to the libraries listed below

• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆214Updated 2 weeks ago
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆686Updated last month
• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆723Updated this week
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆511Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆171Updated last week
• salykova / sgemm.cu
  SGEMM that beats cuBLAS
  ☆68Updated last week
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆183Updated 11 months ago
• Infini-AI-Lab / Sequoia
  scalable and robust tree-based speculative decoding algorithm
  ☆331Updated this week
• apple / ml-recurrent-drafter
  ☆192Updated last week
• triton-lang / triton-cpu
  An experimental CPU backend for Triton
  ☆81Updated last week
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆503Updated this week
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆274Updated this week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆232Updated 3 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆221Updated last week
• efeslab / Nanoflow
  A throughput-oriented high-performance serving framework for LLMs
  ☆714Updated 4 months ago
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆247Updated 9 months ago
• siboehm / SGEMM_CUDA
  Fast CUDA matrix multiplication from scratch
  ☆602Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆157Updated 3 weeks ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆216Updated last week
• IST-DASLab / marlin
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆690Updated 4 months ago
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆175Updated 9 months ago
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆155Updated 6 months ago
• pranjalssh / fast.cu
  Fastest kernels written from scratch
  ☆131Updated 2 months ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆430Updated 4 months ago
• spcl / QuaRot
  Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.
  ☆322Updated 2 months ago
• mit-han-lab / qserve
  QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
  ☆492Updated this week
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆191Updated this week
• kuterd / nv_isa_solver
  Nvidia Instruction Set Specification Generator
  ☆236Updated 6 months ago
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆180Updated 2 months ago