AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inference
☆21Jan 24, 2025Updated last year
Alternatives and similar repositories for AdaSkip
Users that are interested in AdaSkip are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Apr 11, 2024Updated 2 years ago
- Unofficial Evaluation for LLaDA2.0-mini-preview with LM-eval☆11Nov 24, 2025Updated 11 months ago
- Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation☆43Oct 26, 2026Updated 3 weeks ago
- [ACL Findings 2026] Official Implementation of "FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acc…☆34Apr 14, 2026Updated 7 months ago
- PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"☆21Oct 28, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 这个项目会收集、整理各种汉语字词相关的数据,比如常用汉字、词组的列表,常用汉字的词频统计数据、HSK大纲要求掌握的字词数据等。☆18Nov 5, 2019Updated 7 years ago
- ☆14May 23, 2025Updated last year
- ☆14Mar 30, 2026Updated 7 months ago
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Nov 9, 2026Updated last week
- ☆14Jun 25, 2025Updated last year
- ☆25Oct 22, 2026Updated 3 weeks ago
- ☆11May 15, 2020Updated 6 years ago
- Unofficial implementations of block/layer-wise pruning methods for LLMs.☆80Apr 29, 2024Updated 2 years ago
- This is the implementation repository of our SOSP'23 paper: Ditto: An Elastic and Adaptive Memory-Disaggregated Caching System.☆38Sep 24, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [EMNLP 2025🔥] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective☆20Jan 7, 2026Updated 10 months ago
- [ICLR 2026] Mixing Importance with Diversity: Joint Optimization for KV Cache Compression in Large Vision-Language Models☆32Mar 21, 2026Updated 7 months ago
- ☆11Oct 18, 2023Updated 3 years ago
- ☆11Jun 19, 2025Updated last year
- A fault-tolerant RDMA-based disaggregated key-value store with 1-RTT UPDATEs and GETs thanks to the SWARM replication protocol☆14Sep 25, 2024Updated 2 years ago
- ☆25Jun 2, 2026Updated 5 months ago
- ☆23Feb 10, 2025Updated last year
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…☆74Jun 26, 2024Updated 2 years ago
- ☆33Oct 6, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆15Apr 6, 2026Updated 7 months ago
- A curated list of early exiting (LLM, CV, NLP, etc)☆74Aug 21, 2024Updated 2 years ago
- ☆17Mar 18, 2025Updated last year
- ☆20Jun 4, 2026Updated 5 months ago
- An unofficial personal implementation of UM-Adapt, specifically to tackle joint estimation of panoptic segmentation and depth prediction …☆16Oct 4, 2023Updated 3 years ago
- CHERRL: A Controllable Hacking Environment for Rubric-Based Reinforcement Learning☆16Nov 10, 2026Updated last week
- ☆21Apr 3, 2025Updated last year
- ☆50Oct 16, 2025Updated last year
- ☆16Jul 23, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The logging module of the DBx1000 database.☆16Nov 2, 2020Updated 6 years ago
- [FAST 2022] FORD: Fast One-sided RDMA-based Distributed Transactions for Disaggregated Persistent Memory☆63Jun 22, 2024Updated 2 years ago
- Network- and GPU-aware management of serverless functions at the edge☆15Mar 3, 2023Updated 3 years ago
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆55Oct 18, 2024Updated 2 years ago
- Official repo for paper: Universal Reasoner: A Single, Composable Plug-and-Play Reasoner for Frozen LLMs☆20Nov 26, 2025Updated 11 months ago
- A local k3s cluster with Load Balancer, Ingress Controller, and Cert Manager.☆13Jan 20, 2026Updated 9 months ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆57Aug 6, 2025Updated last year
Are these results useful?