☆14Mar 20, 2026Updated 7 months ago
Alternatives and similar repositories for QuantSpec
Users that are interested in QuantSpec are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official repository for QWHA☆13Sep 17, 2025Updated last year
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Updated this week
- Graph Deep Learning☆10Dec 29, 2023Updated 2 years ago
- [NeurIPS 2025] Speculate Deep and Accurate☆25Aug 10, 2026Updated 3 months ago
- ☆23Oct 19, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Dart Language Tutorial☆11Oct 26, 2023Updated 3 years ago
- Energy and carbon-aware extension of Vidur for sustainable LLM inference simulation and analysis 💡🌳☆11Sep 10, 2025Updated last year
- [ACL2025 Oral🔥]Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling☆30Nov 11, 2025Updated last year
- [NeurIPS 2023] Token-Scaled Logit Distillation for Ternary Weight Generative Language Models☆18Dec 6, 2023Updated 2 years ago
- HPYLMのC++実装☆11May 2, 2017Updated 9 years ago
- An Agile RISC-V SoC Design Framework with in-order cores, out-of-order cores, accelerators, and more☆12Aug 7, 2024Updated 2 years ago
- ☆61Dec 19, 2025Updated 10 months ago
- Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition☆21Apr 16, 2025Updated last year
- [ISCA 2025] Official Implementation of "MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization"☆26Oct 30, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11May 24, 2024Updated 2 years ago
- [ACL 2026 Findings] RACER: Retrieval-Augmented Contextual Rapid Speculative Decoding☆18Sep 23, 2026Updated last month
- Modular and structured prompt caching for low-latency LLM inference☆13May 12, 2024Updated 2 years ago
- DeiT implementation for Q-ViT☆26Apr 21, 2025Updated last year
- ☆26Oct 31, 2024Updated 2 years ago
- Official implementation of Blind Localization and Clustering of Anomalies in Textures.☆12Apr 21, 2024Updated 2 years ago
- [OSDI'25] QiMeng-Xpiler: Transcompiling Tensor Programs for Deep Learning Systems with a Neural-Symbolic Approach☆10Jun 20, 2025Updated last year
- ☆31Sep 11, 2026Updated 2 months ago
- ☆17Mar 8, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆27Apr 13, 2025Updated last year
- [TVCG 2024] ReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactions☆24Feb 28, 2025Updated last year
- ☆10Sep 22, 2023Updated 3 years ago
- 个人总结的CSU - CS期末备考复习资料；中南大学-计科；☆25May 23, 2025Updated last year
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆53May 12, 2026Updated 6 months ago
- FreeKV: Boosting KV Cache Retrieval for Efficient LLM Inference (ICLR'26)☆12Mar 5, 2026Updated 8 months ago
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated 2 years ago
- [ACL 26 Findings] LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation☆13Apr 21, 2026Updated 6 months ago
- [ACL Findings 2026] Official Implementation of "FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acc…☆34Apr 14, 2026Updated 6 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Weakly Supervised Object Localization via Class RE-Activation Mapping☆12Sep 19, 2022Updated 4 years ago
- ☆13Jul 19, 2025Updated last year
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆32Feb 17, 2025Updated last year
- ☆21Aug 23, 2023Updated 3 years ago
- LLM Inference with Microscaling Format☆35Nov 12, 2024Updated 2 years ago
- This project demonstrates the process of fine-tuning the Qwen2.5-3B-Instruct model using GRPO (Generalized Reward Policy Optimization) o…☆18Sep 27, 2026Updated last month
- (COLING2025) SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding☆10Dec 18, 2024Updated last year
Are these results useful?