☆26Mar 14, 2024Updated last year
Alternatives and similar repositories for specinfer-ae
Users that are interested in specinfer-ae are comparing it to the libraries listed below
Sorting:
- Multi-Candidate Speculative Decoding☆39Apr 22, 2024Updated last year
- ☆14Aug 19, 2024Updated last year
- C++ SystemC Implementation of a Systolic Array☆16May 15, 2020Updated 5 years ago
- ☆14Jun 4, 2024Updated last year
- [TRETS 2025][FPGA 2024] FPGA Accelerator for Imbalanced SpMV using HLS☆20Aug 24, 2025Updated 6 months ago
- ☆35Nov 28, 2024Updated last year
- ☆28May 24, 2025Updated 9 months ago
- Fast inference from large lauguage models via speculative decoding☆894Aug 22, 2024Updated last year
- ☆66Nov 4, 2024Updated last year
- Python tools for meshing rivers☆12Oct 2, 2025Updated 5 months ago
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆52Jul 15, 2025Updated 7 months ago
- ☆37Jan 20, 2022Updated 4 years ago
- Eyeriss chip simulator☆39Mar 6, 2020Updated 6 years ago
- Design of High-Level Synthesis of Xilinx FFT IP core via FFT library☆14Jul 17, 2023Updated 2 years ago
- ☆46Nov 10, 2023Updated 2 years ago
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆34May 6, 2024Updated last year
- A simple cycle-accurate DaDianNao simulator☆13Mar 27, 2019Updated 6 years ago
- ☆10Mar 3, 2024Updated 2 years ago
- [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading☆13Jun 28, 2025Updated 8 months ago
- Continuous Pipelined Speculative Decoding☆16Jan 4, 2026Updated 2 months ago
- Simulation, multi-path estimation, and CBR parsing code of SIGCOMM2023 BeamSense CBR-Sensing☆10Jan 14, 2024Updated 2 years ago
- ☆10Jun 28, 2019Updated 6 years ago
- Prompt format and padding guide for Llama 2☆12Sep 18, 2023Updated 2 years ago
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated last year
- Residual vector quantization for KV cache compression in large language model☆11Oct 22, 2024Updated last year
- ☆12Aug 26, 2022Updated 3 years ago
- [TVLSI 2025] ACiM Inference Simulation Framework in "ASiM: Modeling and Analyzing Inference Accuracy of SRAM-Based Analog CiM Circuits"☆27Sep 9, 2025Updated 6 months ago
- ☆15Nov 11, 2024Updated last year
- [NeurIPS 2025] Bag of Tricks for Inference-time Computation of LLM Reasoning☆16Sep 20, 2025Updated 5 months ago
- A collection of papers on LLM applications in the IoT field.☆18Jan 21, 2026Updated last month
- ☆16Apr 13, 2025Updated 10 months ago
- Principles and Methodologies for Serial Performance Optimization (OSDI' 25)☆25Jun 5, 2025Updated 9 months ago
- ☆11Sep 3, 2022Updated 3 years ago
- Example to build PyTorch CUDA extension using CMake (with pybind11 and scikit-build)☆11May 26, 2020Updated 5 years ago
- CUDA_C编程权威指南示例代码☆13Mar 22, 2023Updated 2 years ago
- ☆10Sep 2, 2023Updated 2 years ago
- Papers about infrastructure (deployment & serving) and systems for compound AI☆12Nov 6, 2024Updated last year
- ☆10Sep 26, 2024Updated last year
- TPLink IPC Control☆19Jul 24, 2024Updated last year