☆28Mar 14, 2024Updated 2 years ago
Alternatives and similar repositories for specinfer-ae
Users that are interested in specinfer-ae are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multi-Candidate Speculative Decoding☆41Apr 22, 2024Updated 2 years ago
- This is the public repo for DREAM accepted to ICS 2025.☆12Dec 28, 2025Updated 10 months ago
- ☆16Aug 19, 2024Updated 2 years ago
- ☆38Nov 28, 2024Updated last year
- ☆14Sep 21, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- C++ SystemC Implementation of a Systolic Array☆16May 15, 2020Updated 6 years ago
- Fast inference from large lauguage models via speculative decoding☆927Aug 22, 2024Updated 2 years ago
- ☆33May 24, 2025Updated last year
- ☆21May 11, 2026Updated 5 months ago
- [ICCV'2025 Highlight] Efficient Input-level Backdoor Defense on Text-to-Image Synthesis via Neuron Activation Variation☆10Mar 30, 2026Updated 7 months ago
- ☆71Nov 4, 2024Updated 2 years ago
- CHERRL: A Controllable Hacking Environment for Rubric-Based Reinforcement Learning☆16Oct 15, 2026Updated 3 weeks ago
- ☆16Jun 4, 2024Updated 2 years ago
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆70Feb 21, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆20Jan 27, 2025Updated last year
- A selective knowledge distillation algorithm for efficient speculative decoders☆40Nov 27, 2025Updated 11 months ago
- ☆18Feb 13, 2021Updated 5 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- H2-LLM: Hardware-Dataflow Co-Exploration for Heterogeneous Hybrid-Bonding-based Low-Batch LLM Inference☆126Apr 26, 2025Updated last year
- Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training☆1,903Updated this week
- ☆20May 10, 2025Updated last year
- [NeurIPS 2021] Source code for the paper "Qu-ANTI-zation: Exploiting Neural Network Quantization for Achieving Adversarial Outcomes"☆18Nov 9, 2021Updated 4 years ago
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆19Dec 8, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Artifact for "Marconi: Prefix Caching for the Era of Hybrid LLMs" [MLSys '25 Outstanding Paper Award, Honorable Mention]☆74Mar 5, 2025Updated last year
- ☆10Sep 12, 2024Updated 2 years ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆19Jul 10, 2025Updated last year
- ☆10Jun 6, 2026Updated 5 months ago
- Custom Python Scheduler for Kubernetes☆15Jan 25, 2020Updated 6 years ago
- ☆12Mar 24, 2023Updated 3 years ago
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated 2 years ago
- 分享收集的在算法竞赛、数据结构方面的课件、论文、书籍、OJ网站、习题。☆14May 21, 2020Updated 6 years ago
- [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.☆27Apr 21, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Intel AMX matrix multiplication experiments☆13Jan 24, 2024Updated 2 years ago
- [TRETS 2025][FPGA 2024] FPGA Accelerator for Imbalanced SpMV using HLS☆23Aug 24, 2025Updated last year
- ☆15Apr 11, 2024Updated 2 years ago
- Official repository for the paper: "You Only Prune Once: Designing Calibration-Free Model Compression With Policy Learning" [ICLR 2025]☆10Apr 13, 2025Updated last year
- DLL注入工具☆13Nov 9, 2020Updated 5 years ago
- Edge-MoE: Memory-Efficient Multi-Task Vision Transformer Architecture with Task-level Sparsity via Mixture-of-Experts☆144May 10, 2024Updated 2 years ago
- ☆10Apr 5, 2025Updated last year