Alternatives and similar repositories for FusionQuery:

Users that are interested in FusionQuery are comparing it to the libraries listed below

• JingyangXiang / SUBP
  Pytorch implementation of our paper SUBP: Soft Uniform Block Pruning for 1xN Sparse CNNs Multithreading Acceleration accepted by NeurIPS …
  ☆22Updated last year
• VITA-Group / llm-kick
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆23Updated last year
• Aaronhuang-778 / SliM-LLM
  SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆28Updated 7 months ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆31Updated this week
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆52Updated last week
• NonvolatileMemory / flash_tree_attn
  ☆19Updated 3 months ago
• machilusZ / FastGen
  This repo contains the source code for: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  ☆35Updated 7 months ago
• horrible-dong / DNRT
  [ICLR 2024] Dynamic Neural Response Tuning
  ☆16Updated 3 weeks ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆25Updated last week
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆57Updated last year
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆134Updated this week
• wzhuang-xmu / LoSA
  [ICLR 2025] The official pytorch implement of "Dynamic Low-Rank Sparse Adaptation for Large Language Models".
  ☆13Updated 2 weeks ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆85Updated last year
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆47Updated 8 months ago
• JingyangXiang / OvSW
  Pytorch implementation of our paper OvSW: Overcoming Silent Weights for Accurate Binary Neural Networks accepted by ECCV 2024.
  ☆18Updated 8 months ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆33Updated 9 months ago
• GATECH-EIC / PipeGCN
  [ICLR 2022] "PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication" by Cheng Wan, Y…
  ☆32Updated 2 years ago
• thu-ml / Jetfire-INT8Training
  ☆38Updated 8 months ago
• dongwonjo / FastKV
  Official Implementation of FastKV: KV Cache Compression for Fast Long-Context Processing with Token-Selective Propagation
  ☆17Updated 2 months ago
• cornell-zhang / llm-datatypes
  Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs
  ☆25Updated 9 months ago
• graphcore-research / llm-inference-research
  An experimentation platform for LLM inference optimisation
  ☆29Updated 6 months ago
• yxli2123 / LoSparse
  ☆50Updated last year
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆45Updated 4 months ago
• d-matrix-ai / keyformer-llm
  ☆53Updated last year
• FFY0 / AdaKV
  The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  ☆68Updated 2 months ago
• YJHMITWEB / ExFlow
  Explore Inter-layer Expert Affinity in MoE Model Inference
  ☆7Updated 10 months ago
• pprp / Pruner-Zero
  Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆80Updated 4 months ago
• Intelligent-Computing-Lab-Yale / TesseraQ
  ☆19Updated 5 months ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆86Updated last week
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆30Updated 9 months ago