Alternatives and similar repositories for ninetoothed:

Users that are interested in ninetoothed are comparing it to the libraries listed below

• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing. By pro…
  ☆67Updated this week
• tsinghua-ideal / Canvas
  Canvas: End-to-End Kernel Architecture Search in Neural Networks
  ☆26Updated 3 months ago
• InfiniTensor / InfiniLM
  ☆100Updated last week
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆19Updated last month
• TiledTensor / TiledKernel
  TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.
  ☆19Updated 10 months ago
• microsoft / FractalTensor
  ☆24Updated 2 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆144Updated 8 months ago
• hao-ai-lab / MuxServe
  ☆52Updated 9 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆39Updated 10 months ago
• TiledTensor / TiledCUDA
  We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …
  ☆176Updated last month
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆25Updated this week
• WukLab / preble
  Stateful LLM Serving
  ☆46Updated this week
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆149Updated 5 months ago
• LoongServe / LoongServe
  ☆87Updated 4 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆32Updated last month
• InfiniTensor / InfiniTensor
  ☆226Updated last month
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 5 months ago
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆49Updated this week
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆71Updated 2 months ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 3 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆67Updated 6 months ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆29Updated last week
• microsoft / dist-ir
  An IR for efficiently simulating distributed ML computation.
  ☆28Updated last year
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆105Updated last month
• d-matrix-ai / keyformer-llm
  ☆52Updated 11 months ago
• AlibabaPAI / FLASHNN
  ☆87Updated 6 months ago
• apuaaChen / EVT_AE
  Artifacts of EVT ASPLOS'24
  ☆23Updated last year
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆112Updated last year