☆38Feb 12, 2025Updated last year
Alternatives and similar repositories for APE
Users that are interested in APE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Dec 20, 2024Updated last year
- ☆11Jan 2, 2026Updated 9 months ago
- ☆14Jan 20, 2025Updated last year
- ☆20Jun 30, 2025Updated last year
- The official code implementation for paper "PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs"☆33May 24, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆15Jan 10, 2024Updated 2 years ago
- [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference☆58Nov 20, 2024Updated last year
- ☆23Jul 13, 2026Updated 3 months ago
- ☆30Sep 11, 2026Updated last month
- Block-GTQ: RoPE-aware bit allocation for KV-cache quantization☆15Jun 24, 2026Updated 4 months ago
- Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding.☆13Nov 19, 2024Updated last year
- NaturalProver: Grounded Mathematical Proof Generation with Language Models☆40Mar 24, 2023Updated 3 years ago
- Vortex: Programmable Sparse Attention for Agents as Algorithm Designers☆69Aug 22, 2026Updated 2 months ago
- KV cache compression for high-throughput LLM inference☆163Feb 5, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation☆257Dec 16, 2024Updated last year
- Models Take Notes at Prefill: KV Cache Can Be Editable and Composable (arXiv:2606.17107) — paper, code, results, and interactive companio…☆16Jun 29, 2026Updated 4 months ago
- Position-independent caching for hybrid-attention LLM serving.☆20Jul 27, 2026Updated 3 months ago
- Official implementation of STaR-KV: training-free spatio-temporal KV cache compression for efficient GUI vision-language models.☆21Oct 17, 2026Updated last week
- [AAAI 2026] SlimInfer: Accelerating Long-Context LLM Inference via Dynamic Token Pruning☆13Nov 23, 2025Updated 11 months ago
- Evaluate state-of-the-art sparse embedding models on the LIMIT dataset (`limit-small` and `limit`) from google's paper `On the Theoretica…☆16Sep 4, 2025Updated last year
- In-context Example Selection with Influences☆15May 12, 2023Updated 3 years ago
- [ECCV'24 Oral] PiTe: Pixel-Temporal Alignment for Large Video-Language Model☆17Feb 13, 2025Updated last year
- Official implementation of "SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching" (COLM 2025). A novel KV cache com…☆15Sep 29, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Algorithms for approximate nearest neighbor search with window filters☆47Feb 5, 2024Updated 2 years ago
- ☆81Nov 19, 2024Updated last year
- Official Implementation of APB (ACL 2025 main Oral) and Spava (ACL 2026 main).☆37Apr 6, 2026Updated 6 months ago
- A minimal open-source on-policy-distillation implementation☆11May 21, 2026Updated 5 months ago
- ☆13Nov 16, 2024Updated last year
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation☆36Feb 26, 2026Updated 8 months ago
- Customized Inference Engine for Multiverse Models☆26Jun 27, 2025Updated last year
- [AAAI'26 Oral] Official Implementation of STAR-1: Safer Alignment of Reasoning LLMs with 1K Data☆38Apr 7, 2025Updated last year
- PERK: Long-Context Reasoning as Test-Time Learning☆15Sep 25, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The code for "AttentionPredictor: Temporal Pattern Matters for Efficient LLM Inference", Qingyue Yang, Jie Wang, Xing Li, Zhihai Wang, Ch…☆29Jul 15, 2025Updated last year
- [NeurIPS'25] KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems☆199Nov 3, 2025Updated 11 months ago
- [EMNLP 2025] DiagramEval: Evaluating LLM-Generated Diagrams via Graphs☆17Nov 1, 2025Updated 11 months ago
- Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference☆51Jun 19, 2024Updated 2 years ago
- ☆12Apr 25, 2025Updated last year
- ☆13Aug 13, 2024Updated 2 years ago
- GPTQ inference TVM kernel☆41Apr 25, 2024Updated 2 years ago