Position-independent caching for hybrid-attention LLM serving.
☆20Jul 27, 2026Updated 3 months ago
Alternatives and similar repositories for HYPIC
Users that are interested in HYPIC are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of an efficient LLM architecture: the Pair-In / Pair-Out Model (PIPO)☆43Jun 10, 2026Updated 5 months ago
- Official code, data, and models for "Hint Tuning: Less Data Makes Better Reasoners"☆23Jul 8, 2026Updated 4 months ago
- Official Codebase for .☆18Oct 25, 2026Updated 3 weeks ago
- Hybrid GUI + MCP computer-use agents with reinforcement learning for tool use and multimodal context compression on OSWorld. Includes tra…☆17Aug 5, 2026Updated 3 months ago
- [ICLR 2026] LookaheadKV: Fast and Accurate KV Cache Eviction by Glimpsing into the Future without Generation☆14Mar 16, 2026Updated 8 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated 2 months ago
- Per-step LLM routing benchmark with 970 static labels, live SWE-bench evaluation, an open data pipeline, and a public leaderboard.☆34Oct 28, 2026Updated 2 weeks ago
- CITETRACER: Cascading Multi-Agent for Citation Hallucination Detection☆14Oct 26, 2026Updated 3 weeks ago
- [AAAI 2026] SlimInfer: Accelerating Long-Context LLM Inference via Dynamic Token Pruning☆13Nov 23, 2025Updated 11 months ago
- ☆13Mar 18, 2024Updated 2 years ago
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- 2021秋北航计算机组成原理☆22Mar 31, 2022Updated 4 years ago
- We apply attention on LSTM to give more weight to the items which are more relevant for next-item prediction☆10Dec 26, 2018Updated 7 years ago
- ☆10May 19, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆15Jan 24, 2022Updated 4 years ago
- [ICLR 2026] SERE: Similarity-Based Expert Re-routing for Efficient Batch Decoding in MoE Models☆24Feb 4, 2026Updated 9 months ago
- Find out why your program crashed, even when the logs say nothing.☆17Updated this week
- ☆18Apr 21, 2026Updated 6 months ago
- ☆23Jun 23, 2026Updated 4 months ago
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆38Aug 14, 2026Updated 3 months ago
- Acclaim: Adaptive Memory Reclaim to Improve User Experience in Android Systems [ATC '20]☆16Aug 1, 2020Updated 6 years ago
- ☆16Jul 9, 2024Updated 2 years ago
- ☆12May 27, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆11Oct 29, 2026Updated 2 weeks ago
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving☆33Aug 28, 2026Updated 2 months ago
- SOTA benchmark☆18Aug 8, 2023Updated 3 years ago
- Implementation of the standard SenseGlove API into an example ros_workspace. The workspace features a few publishing topics where users c…☆10Mar 15, 2026Updated 8 months ago
- TTPO: Test-Time Policy Optimization☆74Oct 2, 2026Updated last month
- A Bytecode level Implementation of Symbolic OpCode Translator For PaddlePaddle☆15Oct 13, 2023Updated 3 years ago
- [ICML 2026] Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models☆13May 8, 2026Updated 6 months ago
- [PREVIEW] Implementation of paper "Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models"☆13May 5, 2026Updated 6 months ago
- ☆12May 8, 2026Updated 6 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale☆676Updated this week
- ☆15May 20, 2022Updated 4 years ago
- The official repo of "Draft-OPD: On-Policy Distillation for Speculative Draft Models"☆84Sep 4, 2026Updated 2 months ago
- The Artifact Evaluation Version of SOSP Paper #19☆55Aug 19, 2024Updated 2 years ago
- ☆16Aug 26, 2026Updated 2 months ago
- dlmrt: a single-request inference engine for block-diffusion language models☆18Nov 3, 2026Updated last week
- Rust bindings for the [3FS USRBIO API](https://github.com/deepseek-ai/3FS/blob/main/src/lib/api/UsrbIo.md).☆11Nov 4, 2026Updated last week
Are these results useful?