Alternatives and similar repositories for glinthawk

Users that are interested in glinthawk are comparing it to the libraries listed below

• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆141Updated last year
• cornserve-ai / cornserve
  Easy, Fast, and Scalable Multimodal AI
  ☆106Updated last week
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆83Updated 11 months ago
• tyler-griggs / melange-release
  ☆48Updated last year
• UCB-ADRS / ADRS
  AI-Driven Research Systems (ADRS)
  ☆117Updated last month
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆53Updated 6 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆151Updated last year
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆51Updated 7 months ago
• RLsys-Foundation / TritonForge
  🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…
  ☆116Updated 2 months ago
• Infini-AI-Lab / APE
  ☆36Updated 11 months ago
• sgl-project / sgl-flash-attn
  Fast and memory-efficient exact attention
  ☆18Updated 2 weeks ago
• hao-ai-lab / LookaheadReasoning
  [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning
  ☆63Updated 3 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆209Updated last year
• Hanchenli / vllm-continuum
  Preview Code for Continuum Paper
  ☆32Updated last week
• hao-ai-lab / DistCA
  Efficient Long-context Language Model Training by Core Attention Disaggregation
  ☆85Updated last week
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆176Updated last year
• microsoft / tokenweave
  Accepted to MLSys 2026
  ☆70Updated last week
• FasterDecoding / TEAL
  ☆158Updated 11 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 9 months ago
• microsoft / RetrievalAttention
  Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.
  ☆122Updated last month
• Infini-AI-Lab / vortex_torch
  Vortex: A Flexible and Efficient Sparse Attention Framework
  ☆45Updated 2 weeks ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆73Updated 9 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆93Updated 2 years ago
• microsoft / AttentionEngine
  ☆117Updated 8 months ago
• deepseek-ai / LPLB
  An early research stage expert-parallel load balancer for MoE models based on linear programming.
  ☆495Updated 2 months ago
• TransferQueue / TransferQueue
  [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…
  ☆13Updated 3 weeks ago
• alibaba / SRDiffusion
  Accelerate Video Diffusion Inference via Sketching-Rendering Cooperation
  ☆19Updated 7 months ago
• metacarbon / shareAtt
  Beyond KV Caching: Shared Attention for Efficient LLMs
  ☆20Updated last year
• Dao-AILab / grouped-latent-attention
  ☆132Updated 8 months ago
• LLMkvsys / rethink-kv-compression
  ☆22Updated 10 months ago