Alternatives and similar repositories for specinfer-ae

Users that are interested in specinfer-ae are comparing it to the libraries listed below

• NJUNLP / MCSD

  View on GitHub
  Multi-Candidate Speculative Decoding
  ☆39Apr 22, 2024Updated last year
• kimkoech / Systolic-Array

  View on GitHub
  C++ SystemC Implementation of a Systolic Array
  ☆14May 15, 2020Updated 5 years ago
• uw-mad-dash / decoding-speculative-decoding

  View on GitHub
  ☆14Aug 19, 2024Updated last year
• VITA-Group / Q-Hitter

  View on GitHub
  ☆15Jun 4, 2024Updated last year
• SFU-HiAccel / HiSpMV

  View on GitHub
  [TRETS 2025][FPGA 2024] FPGA Accelerator for Imbalanced SpMV using HLS
  ☆20Aug 24, 2025Updated 5 months ago
• PSCLab-ASU / Systolic-CNN

  View on GitHub
  ☆17Feb 13, 2021Updated 5 years ago
• caoshiyi / artifacts

  View on GitHub
  ☆35Nov 28, 2024Updated last year
• Jikai0Wang / OPT-Tree

  View on GitHub
  ☆28May 24, 2025Updated 8 months ago
• yandex-research / specexec

  View on GitHub
  ☆66Nov 4, 2024Updated last year
• feifeibear / LLMSpeculativeSampling

  View on GitHub
  Fast inference from large lauguage models via speculative decoding
  ☆886Aug 22, 2024Updated last year
• epic-open-source / evaluation-instruments

  View on GitHub
  ☆17Dec 30, 2025Updated last month
• schism-dev / RiverMeshTools

  View on GitHub
  Python tools for meshing rivers
  ☆12Oct 2, 2025Updated 4 months ago
• Xilinx / libdfx

  View on GitHub
  ☆13Jan 28, 2026Updated 2 weeks ago
• thunlp / FR-Spec

  View on GitHub
  [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling
  ☆49Jul 15, 2025Updated 7 months ago
• sharc-lab / GenGNN

  View on GitHub
  ☆37Jan 20, 2022Updated 4 years ago
• DYGV / HLS_FFT

  View on GitHub
  Design of High-Level Synthesis of Xilinx FFT IP core via FFT library
  ☆13Jul 17, 2023Updated 2 years ago
• exists-forall / striped_attention

  View on GitHub
  ☆45Nov 10, 2023Updated 2 years ago
• IronySuzumiya / NiuDianNao

  View on GitHub
  A simple cycle-accurate DaDianNao simulator
  ☆13Mar 27, 2019Updated 6 years ago
• Leosang-lx / FlowSpec

  View on GitHub
  Continuous Pipelined Speculative Decoding
  ☆16Jan 4, 2026Updated last month
• Vito-Swift / sigcomm23-BeamSense

  View on GitHub
  Simulation, multi-path estimation, and CBR parsing code of SIGCOMM2023 BeamSense CBR-Sensing
  ☆10Jan 14, 2024Updated 2 years ago
• iankur / vqllm

  View on GitHub
  Residual vector quantization for KV cache compression in large language model
  ☆11Oct 22, 2024Updated last year
• yc2367 / BBS-MICRO

  View on GitHub
  ☆15Nov 11, 2024Updated last year
• huqinghao / PalQuant

  View on GitHub
  ☆12Aug 26, 2022Updated 3 years ago
• AIS-SNU / GraNNDis_Artifact

  View on GitHub
  [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…
  ☆10Aug 13, 2024Updated last year
• KAIWEILIUCC / Awesome-LLM-IoT-Papers

  View on GitHub
  A collection of papers on LLM applications in the IoT field.
  ☆18Jan 21, 2026Updated 3 weeks ago
• gem5-hpca-2024 / gem5

  View on GitHub
  ☆10Mar 3, 2024Updated last year
• TrelisResearch / llama-2-setup

  View on GitHub
  Prompt format and padding guide for Llama 2
  ☆12Sep 18, 2023Updated 2 years ago
• hyungyokim / LIA_AMXGPU

  View on GitHub
  [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading
  ☆13Jun 28, 2025Updated 7 months ago
• Keio-CSG / ASiM

  View on GitHub
  [TVLSI 2025] ACiM Inference Simulation Framework in "ASiM: Modeling and Analyzing Inference Accuracy of SRAM-Based Analog CiM Circuits"
  ☆25Sep 9, 2025Updated 5 months ago
• BradMcDanel / multiplication-free-dnn

  View on GitHub
  ☆10Jun 28, 2019Updated 6 years ago
• weihai-98 / A-2Q

  View on GitHub
  ☆11Sep 30, 2023Updated 2 years ago
• sen-ye / linux-clash

  View on GitHub
  ☆10Nov 14, 2023Updated 2 years ago
• sslab-gatech / SysGPT

  View on GitHub
  Principles and Methodologies for Serial Performance Optimization (OSDI' 25)
  ☆25Jun 5, 2025Updated 8 months ago
• openebs-archive / spdk-sys

  View on GitHub
  Rust bindings for SPDK
  ☆12Mar 5, 2020Updated 5 years ago
• xiaodong-lx / tplink-ipc-control

  View on GitHub
  TPLink IPC Control
  ☆19Jul 24, 2024Updated last year
• RW999creator / GPP-PIM

  View on GitHub
  ☆10Sep 26, 2024Updated last year
• ElvisCheny / CUDA_C-Code

  View on GitHub
  CUDA_C编程权威指南示例代码
  ☆12Mar 22, 2023Updated 2 years ago
• outerport / awesome-compound-ai-systems

  View on GitHub
  Papers about infrastructure (deployment & serving) and systems for compound AI
  ☆12Nov 6, 2024Updated last year
• ethz-spylab / misleading-privacy-evals

  View on GitHub
  Official code for "Evaluations of Machine Learning Privacy Defenses are Misleading" (https://arxiv.org/abs/2404.17399)
  ☆12Apr 29, 2024Updated last year