Alternatives and similar repositories for FlashOverlap:

Users that are interested in FlashOverlap are comparing it to the libraries listed below

• flashinfer-ai / cutlass-viz
  ☆57Updated last week
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆68Updated this week
• xlite-dev / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆74Updated last month
• AlibabaPAI / FLASHNN
  ☆93Updated 7 months ago
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆34Updated this week
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 5 months ago
• hao-ai-lab / MuxServe
  ☆59Updated 10 months ago
• CalebDu / Awesome-Cute
  ☆66Updated 2 weeks ago
• WukLab / preble
  Stateful LLM Serving
  ☆65Updated last month
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆43Updated last month
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆34Updated last week
• shenh10 / DeepSeek_Simulator
  ☆60Updated last month
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆78Updated 4 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆109Updated this week
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆84Updated this week
• yifuwang / symm-mem-recipes
  ☆70Updated 4 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆119Updated 3 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆60Updated 11 months ago
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆25Updated 2 months ago
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆36Updated last year
• LoongServe / LoongServe
  ☆95Updated 5 months ago
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆17Updated last year
• triton-lang / kernels
  ☆78Updated 5 months ago
• TiledTensor / TiledCUDA
  We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …
  ☆181Updated 3 months ago
• InternLM / turbomind
  ☆84Updated last month
• Relaxed-System-Lab / HexGen
  [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.
  ☆25Updated last year
• weishengying / cutlass_flash_atten_fp8
  使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention
  ☆64Updated 8 months ago
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 7 months ago
• ColfaxResearch / cfx-article-src
  ☆104Updated last month
• uccl-project / uccl
  Ultra | Ultimate | Unified CCL
  ☆65Updated 2 months ago