[AAAI 2026] SlimInfer: Accelerating Long-Context LLM Inference via Dynamic Token Pruning
☆13Nov 23, 2025Updated 11 months ago
Alternatives and similar repositories for SlimInfer
Users that are interested in SlimInfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2026] Focus-dLLM: Accelerating Long-Context Diffusion LLM Inference via Confidence-Guided Context Focusing".☆14Nov 5, 2026Updated last week
- A high-throughput training framework for Speculative decoding models.☆56Updated this week
- compiler design for 2021-BUAA-Compiler-lecture☆17Jan 8, 2022Updated 4 years ago
- The code for "AttentionPredictor: Temporal Pattern Matters for Efficient LLM Inference", Qingyue Yang, Jie Wang, Xing Li, Zhihai Wang, Ch…☆29Jul 15, 2025Updated last year
- SparseServe: Unlocking Parallelism for Dynamic Sparse Attention in Long-Context LLM Serving☆14Sep 30, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- PowerShell script to activate Windows 11 Pro☆19Jun 22, 2025Updated last year
- Official repository of: Attention Sinks in Diffusion Language Models☆12Dec 10, 2025Updated 11 months ago
- [CVPR2026] V-Attack: Targeting Disentangled Value Features for Controllable Adversarial Attacks on LVLMs☆24Dec 8, 2025Updated 11 months ago
- BUAA X86 汇编程序设计 课程笔记和实验作业☆32Jun 12, 2022Updated 4 years ago
- ☆21Oct 20, 2026Updated 3 weeks ago
- ☆14Nov 18, 2025Updated last year
- CITETRACER: Cascading Multi-Agent for Citation Hallucination Detection☆14Oct 26, 2026Updated 3 weeks ago
- (ICLR 2025) BinaryDM: Accurate Weight Binarization for Efficient Diffusion Models☆25Oct 4, 2024Updated 2 years ago
- ☆16Apr 8, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 武汉大学2021级网安舆情分析大作业☆11May 25, 2024Updated 2 years ago
- We introduce UltraLLaDA , a scaled variant of LLaDA-8B-Base that extends the context length up to 128K tokens with light-weight post-trai…☆15Oct 23, 2025Updated last year
- Generate presentation slides automatically using AI from text, PDFs, or structured content.☆18Mar 17, 2026Updated 8 months ago
- Lint modeling, modular, and configuration files for structural conventions☆12Updated this week
- USTB 本科毕业论文 LaTeX 模板☆16Jun 4, 2025Updated last year
- An experimental artificial life platform for embodied synthetic cognition and procedural morphogenesis, from individual beings to worlds …☆15Nov 5, 2026Updated last week
- Official implementation of NeurIPS2024 paper "Active Perception for Grasp Detection via Neural Graspness Field"☆21Apr 21, 2025Updated last year
- ☆18Updated this week
- Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM☆14Dec 27, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Position-independent caching for hybrid-attention LLM serving.☆20Jul 27, 2026Updated 3 months ago
- BUAA Computer Organization 北航 计组☆14Apr 10, 2022Updated 4 years ago
- Real_Time_Clock_With_Alarm☆15Sep 18, 2020Updated 6 years ago
- Image segmentation framework in Java (Computer Graphics project at itba.edu.ar)☆15Oct 1, 2020Updated 6 years ago
- ☆13Jun 16, 2024Updated 2 years ago
- Upkeep — an AI audit crew for your repo. Catches docs/spec/asset drift with evidence; output-only. Claude Code plugin/skill + reusable CI…☆17Updated this week
- A tool for model sparse based on torch.fx☆13Jun 3, 2024Updated 2 years ago
- High-fidelity transcript memory for Claude Code — index every session, recall byte-identical, search, prune, compose. Local-first, stdlib…☆19Aug 10, 2026Updated 3 months ago
- AC No Code 是偷懒者最好的在OJ中写代码AC的方式: Write nothing; submit nowhere.☆10May 18, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- a linux OS on MIPS r3000 chip☆10Jul 5, 2019Updated 7 years ago
- ☆86Jun 2, 2026Updated 5 months ago
- [ICML 2025] This is the official PyTorch implementation of "🎵 HarmoniCa: Harmonizing Training and Inference for Better Feature Caching i…☆46Jul 10, 2025Updated last year
- ☆20Jun 30, 2025Updated last year
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆22Aug 6, 2026Updated 3 months ago
- ☆17Jun 30, 2025Updated last year
- Find abandoned, deprecated and single-maintainer npm dependencies before they become supply-chain incidents. Zero-dep CLI + GitHub Action…☆26Updated this week
Are these results useful?