Alternatives and similar repositories for LLMReasoning-SpecSearch

Users that are interested in LLMReasoning-SpecSearch are comparing it to the libraries listed below

• chicwzh / AI4EDA-MUTE
  This is the code for our ICLR 2025 paper, titled Computing Circuits Optimization via Model-Based Circuit Genetic Evolution.
  ☆12Updated 8 months ago
• goliaro / specinfer-ae
  ☆26Updated last year
• stephenqz / OATS
  Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition
  ☆17Updated 9 months ago
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆70Updated 9 months ago
• fuvty / DeSCo
  [WSDM'24 Oral] The official implementation of paper <DeSCo: Towards Generalizable and Scalable Deep Subgraph Counting>
  ☆23Updated last year
• antgroup / cakekv
  ☆34Updated 10 months ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆341Updated 3 months ago
• thu-nics / nicsefc-readme
  some docs for rookies in nics-efc
  ☆22Updated 3 years ago
• pku-liang / ArkVale
  ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
  ☆53Updated last year
• PrincetonUniversity / LLMCompass
  ☆224Updated 3 months ago
• clevercool / ANT-Quantization
  ☆113Updated 2 years ago
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆281Updated 2 months ago
• SJTU-ReArch-Group / Paper-Reading-List
  ☆145Updated last month
• ZhengaoLi / DISP-LLM-Dimension-Independent-Structural-Pruning
  An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.
  ☆23Updated 6 months ago
• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆136Updated last year
• Geralt-Targaryen / Awesome-Speculative-Decoding
  Reading notes on Speculative Decoding papers
  ☆21Updated 2 months ago
• tsinghua-ideal / Twilight
  [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning
  ☆87Updated 2 months ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆411Updated 11 months ago
• Paramathic / slim
  SLiM: One-shot Quantized Sparse Plus Low-rank Approximation of LLMs (ICML 2025)
  ☆32Updated 2 months ago
• snu-comparch / Tender
  Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)
  ☆25Updated last year
• PKU-SEC-Lab / AdapMoE
  Code release for AdapMoE accepted by ICCAD 2024
  ☆35Updated 9 months ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆372Updated 7 months ago
• Toseic / LLM-inference-arxiv-daily
  🎓Automatically Update LLM inference systems Papers Daily using Github Actions (Update Every 12th hours)
  ☆12Updated this week
• shadowpa0327 / Palu
  [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
  ☆155Updated 11 months ago
• pprp / Awesome-LLM-Prune
  Awesome list for LLM pruning.
  ☆282Updated 4 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆173Updated 2 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆147Updated last month
• cornell-zhang / llm-datatypes
  Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs
  ☆27Updated last year
• PDZZXL / Awesome-LLM-Serving
  Large Language Model (LLM) Serving Paper and Resource List
  ☆24Updated 8 months ago
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆174Updated last year