goliaro/specinfer-ae external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

goliaro/specinfer-ae

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/goliaro/specinfer-ae)

Close

goliaro / specinfer-aeView on GitHubMore

• External links
• Readme badge

☆28Mar 14, 2024Updated 2 years ago

Alternatives and similar repositories for specinfer-ae

Users that are interested in specinfer-ae are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• NJUNLP / MCSD

  View on GitHub
  Multi-Candidate Speculative Decoding
  ☆41Apr 22, 2024Updated 2 years ago
• caoshiyi / artifacts

  View on GitHub
  ☆38Nov 28, 2024Updated last year
• kimkoech / Systolic-Array

  View on GitHub
  C++ SystemC Implementation of a Systolic Array
  ☆16May 15, 2020Updated 6 years ago
• LLMServe / hydraserve

  View on GitHub
  ☆21May 11, 2026Updated 5 months ago
• Jikai0Wang / OPT-Tree

  View on GitHub
  ☆32May 24, 2025Updated last year
• Serverless GPU API endpoints on Runpod - Get Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• yandex-research / specexec

  View on GitHub
  ☆69Nov 4, 2024Updated last year
• VITA-Group / Q-Hitter

  View on GitHub
  ☆16Jun 4, 2024Updated 2 years ago
• feifeibear / LLMSpeculativeSampling

  View on GitHub
  Fast inference from large lauguage models via speculative decoding
  ☆927Aug 22, 2024Updated 2 years ago
• a1bc2def6g / fastgl-ae

  View on GitHub
  ☆17Jun 25, 2024Updated 2 years ago
• promoe-opensource / promoe

  View on GitHub
  ☆20Jan 27, 2025Updated last year
• AutonomicPerfectionist / PipeInfer

  View on GitHub
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆33Nov 16, 2024Updated last year
• PSCLab-ASU / Systolic-CNN

  View on GitHub
  ☆18Feb 13, 2021Updated 5 years ago
• iankur / vqllm

  View on GitHub
  Residual vector quantization for KV cache compression in large language model
  ☆12Oct 22, 2024Updated last year
• inpluslab-wuhui / Systems-for-Foundation-Models

  View on GitHub
  ☆20May 10, 2025Updated last year
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• SFU-HiAccel / HiSpMV

  View on GitHub
  [TRETS 2025][FPGA 2024] FPGA Accelerator for Imbalanced SpMV using HLS
  ☆23Aug 24, 2025Updated last year
• awslabs / optimizing-multitask-training-through-dynamic-pipelines

  View on GitHub
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆19Dec 8, 2023Updated 2 years ago
• hemingkx / SWIFT

  View on GitHub
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆70Feb 21, 2025Updated last year
• Adaxry / Unified_Layer_Skipping

  View on GitHub
  ☆15Apr 11, 2024Updated 2 years ago
• VITA-Group / llm-kick

  View on GitHub
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆27Apr 21, 2025Updated last year
• hbiyik / hw_necromancer

  View on GitHub
  ☆10Jun 6, 2026Updated 4 months ago
• ybingo / OI_Sharing

  View on GitHub
  分享收集的在算法竞赛、数据结构方面的课件、论文、书籍、OJ网站、习题。
  ☆14May 21, 2020Updated 6 years ago
• deJQK / FracBits

  View on GitHub
  Neural Network Quantization With Fractional Bit-widths
  ☆11Feb 19, 2021Updated 5 years ago
• hemingkx / Spec-Bench

  View on GitHub
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆415Apr 22, 2025Updated last year
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• Xilinx / libdfx

  View on GitHub
  ☆13Sep 9, 2026Updated last month
• NorbertZheng / SoC-Lab

  View on GitHub
  大二下学期——计算机系统综合(SoC)——实验
  ☆11Apr 23, 2019Updated 7 years ago
• sharc-lab / GenGNN

  View on GitHub
  ☆37Jan 20, 2022Updated 4 years ago
• luoyesiqiu / LibInject

  View on GitHub
  DLL注入工具
  ☆13Nov 9, 2020Updated 5 years ago
• tissue3 / EyerissSimulator

  View on GitHub
  Eyeriss chip simulator
  ☆42Mar 6, 2020Updated 6 years ago
• flexflow / flexflow-train

  View on GitHub
  Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training
  ☆1,900Oct 11, 2026Updated last week
• dilab-zju / self-speculative-decoding

  View on GitHub
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆230Feb 13, 2025Updated last year
• IronySuzumiya / NiuDianNao

  View on GitHub
  A simple cycle-accurate DaDianNao simulator
  ☆13Mar 27, 2019Updated 7 years ago
• RW999creator / GPP-PIM

  View on GitHub
  ☆10Sep 26, 2024Updated 2 years ago
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• hemingkx / SpeculativeDecodingPapers

  View on GitHub
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆1,299Jun 27, 2026Updated 3 months ago
• Vito-Swift / sigcomm23-BeamSense

  View on GitHub
  Simulation, multi-path estimation, and CBR parsing code of SIGCOMM2023 BeamSense CBR-Sensing
  ☆10Jan 14, 2024Updated 2 years ago
• HaiBooLang / TryOpenGL

  View on GitHub
  OpenGL 学习代码
  ☆15Jun 25, 2023Updated 3 years ago
• lucidrains / speculative-decoding

  View on GitHub
  Explorations into some recent techniques surrounding speculative decoding
  ☆308Dec 22, 2024Updated last year
• Relaxed-System-Lab / HexGen

  View on GitHub
  [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.
  ☆38May 6, 2024Updated 2 years ago
• mean9park / BitFusion-verilog

  View on GitHub
  bitfusion verilog implementation
  ☆13Feb 21, 2022Updated 4 years ago
• alibaba / llm-scheduling-artifact

  View on GitHub
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆66Jun 5, 2024Updated 2 years ago