Alternatives and similar repositories for flexflow-serve:

Users that are interested in flexflow-serve are comparing it to the libraries listed below

• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆103Updated last month
• DefTruth / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆53Updated last week
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆97Updated 2 weeks ago
• microsoft / TileFusion
  TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.
  ☆60Updated this week
• yifuwang / symm-mem-recipes
  ☆47Updated 2 months ago
• LoongServe / LoongServe
  ☆83Updated 3 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆46Updated 7 months ago
• hao-ai-lab / MuxServe
  ☆50Updated 8 months ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 3 months ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆89Updated this week
• CalebDu / Awesome-Cute
  ☆39Updated last month
• AlibabaPAI / FLASHNN
  ☆81Updated 5 months ago
• parasailteam / coconet
  ☆75Updated 2 years ago
• heheda12345 / MagPy
  ☆38Updated 8 months ago
• TiledTensor / TiledCUDA
  We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …
  ☆176Updated last month
• INT-FlashAttention2024 / INT-FlashAttention
  ☆60Updated last month
• ColfaxResearch / cfx-article-src
  ☆75Updated last week
• triton-lang / kernels
  ☆71Updated 3 months ago
• zhuohan123 / terapipe
  ☆72Updated 3 years ago
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆117Updated 2 years ago
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 5 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆104Updated 5 months ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆51Updated last month
• nox-410 / tvm.tl
  An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.
  ☆51Updated 7 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆100Updated 7 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆70Updated 2 months ago
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆50Updated 9 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆60Updated 8 months ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆88Updated last year
• google / iopddl
  Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning
  ☆23Updated 2 months ago