Alternatives and similar repositories for FusionQuery

Users that are interested in FusionQuery are comparing it to the libraries listed below

• JingyangXiang / SUBP
  Pytorch implementation of our paper SUBP: Soft Uniform Block Pruning for 1xN Sparse CNNs Multithreading Acceleration accepted by NeurIPS …
  ☆22Updated last year
• vqpy / vqpy
  VQPy: An object-oriented approach to modern video analytics
  ☆42Updated 10 months ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆105Updated 6 months ago
• microsoft / RetrievalAttention
  Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.
  ☆81Updated last week
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆183Updated last year
• Aaronhuang-778 / SliM-LLM
  [ICML 2025] SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆44Updated last year
• JingyangXiang / DFRot
  [COLM 2025] DFRot: Achieving Outlier-Free and Massive Activation-Free for Rotated LLMs with Refined Rotation; 知乎：https://zhuanlan.zhihu.c…
  ☆26Updated 6 months ago
• HugoZHL / PQCache
  [SIGMOD 2025] PQCache: Product Quantization-based KVCache for Long Context LLM Inference
  ☆71Updated 3 months ago
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆43Updated 2 weeks ago
• amirzandieh / QJL
  QJL: 1-Bit Quantized JL transform for KV Cache Quantization with Zero Overhead
  ☆29Updated 7 months ago
• microsoft / Moonlit
  This is a collection of our research on efficient AI, covering hardware-aware NAS and model compression.
  ☆83Updated 11 months ago
• cat538 / SKVQ
  [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
  ☆24Updated 11 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆59Updated 10 months ago
• hao-ai-lab / MuxServe
  ☆71Updated last year
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 7 months ago
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆115Updated 2 months ago
• eth-easl / modyn
  Modyn is a research-platform for training ML models on growing datasets.
  ☆48Updated 4 months ago
• thunlp / Seq1F1B
  Sequence-level 1F1B schedule for LLMs.
  ☆32Updated last month
• microsoft / chunk-attention
  ☆78Updated 5 months ago
• VITA-Group / llm-kick
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆24Updated 5 months ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆47Updated last month
• LLMkvsys / rethink-kv-compression
  ☆18Updated 6 months ago
• ACA-Lab-SJTU / token-ring
  ☆12Updated 8 months ago
• amazon-science / piperag
  PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)
  ☆24Updated last year
• ruipeterpan / marconi
  Artifact for "Marconi: Prefix Caching for the Era of Hybrid LLMs" [MLSys '25 Outstanding Paper Award, Honorable Mention]
  ☆32Updated 6 months ago
• FFY0 / AdaKV
  The Official Implementation of Ada-KV [NeurIPS 2025]
  ☆95Updated last week
• tsinghua-ideal / Twilight
  Adaptive Attention Sparsity with Hierarchical Top-p Pruning
  ☆19Updated 7 months ago
• YaoJiayi / CacheBlend
  ☆137Updated 2 months ago
• ovg-project / kvcached
  kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.
  ☆93Updated this week
• heheda12345 / MagPy
  ☆39Updated last year