[COLM 2025] DEL: Context-Aware Dynamic Exit Layer for Efficient Self-Speculative Decoding
☆11May 11, 2026Updated 6 months ago
Alternatives and similar repositories for DEL
Users that are interested in DEL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…☆74Jun 26, 2024Updated 2 years ago
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆70Feb 21, 2025Updated last year
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆383Jul 20, 2026Updated 4 months ago
- 本项目是一个完整的RAG系统教程,涵盖了从基础概念到高级技术的全面内容。通过Jupyter Notebook的形式,逐步讲解如何构建和优化一个高效的检索增强生成系统。本项目使用的所有模型都是本地化部署的,在3090上可以运行。☆16Nov 25, 2025Updated 11 months ago
- Mesh: A lightweight, distributed, relational network architecture for MPC☆12Apr 2, 2026Updated 7 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Greed is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation☆10May 20, 2021Updated 5 years ago
- ☆24Oct 5, 2025Updated last year
- [KDD 2025] The source code for UQABench☆12Aug 18, 2025Updated last year
- Local DeepSearch (Advantage: Low Threshold): an implementation of Agentic RAG based on DeepSeek-R1 API and Tavily API☆18Jun 21, 2025Updated last year
- ☆13Jul 9, 2024Updated 2 years ago
- ☆16Aug 5, 2021Updated 5 years ago
- This project explores training data extraction attacks on the LLaMa 7B, GPT-2XL, and GPT-2-IMDB models to discover memorized content usin…☆15Jun 15, 2023Updated 3 years ago
- A device-cloud distributed RAG framework that enables a simultaneous integration of personalized information and generic knowledge☆13Apr 17, 2025Updated last year
- Curated list of open Call-for-Papers in SE/PL scientific conferences: we keep an eye on all of them!☆21Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICML 2025] AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism☆20Jul 14, 2025Updated last year
- placeholder☆12Jan 31, 2025Updated last year
- AdaptiveStep: Automatically Dividing Reasoning Step through Model Confidence☆11Mar 2, 2025Updated last year
- KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation☆24Nov 3, 2024Updated 2 years ago
- Oversubscription of GPU Memory through Transparent Swapping☆15Mar 27, 2015Updated 11 years ago
- Efficient Inference for Large Language Model-based Generative Recommendation (ICLR'25)☆15May 27, 2025Updated last year
- UCB-CS61C project3 : RISC-V CPU design☆11Mar 19, 2023Updated 3 years ago
- Correlated Low-rank Structure (CoLR) for Federated Recommendation System☆13May 31, 2026Updated 5 months ago
- Course project for UCB-CS168☆18Jun 8, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- MLOT - A machine learning algorithm, written for use with MATLAB, in order to track in 3D moving particles based on a training data set. …☆12Dec 24, 2018Updated 7 years ago
- The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"☆17Mar 17, 2025Updated last year
- ☆14Nov 7, 2024Updated 2 years ago
- Course planning service for SJTU☆24Apr 1, 2026Updated 7 months ago
- The speculative decoding for uav environment☆16Oct 18, 2025Updated last year
- Forecasting library in python☆13Sep 6, 2019Updated 7 years ago
- A simple implementation of DP-RAG☆21Mar 17, 2025Updated last year
- lanmt ebm☆12Jun 19, 2020Updated 6 years ago
- MySQL 45道练习题☆12Mar 26, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- AutoWeka for python☆29May 13, 2014Updated 12 years ago
- ☆11Nov 6, 2020Updated 6 years ago
- ☆16Jan 14, 2025Updated last year
- Pyramidal Recurrent Units (PRUs): A New LSTM Unit☆10Aug 29, 2018Updated 8 years ago
- Herald: Accelerating Neural Recommendation Training with Embedding Scheduling (NSDI 2024)☆24May 9, 2024Updated 2 years ago
- Adversarial Subword Regularization forRobust Neural Machine Translation☆10Nov 23, 2022Updated 3 years ago
- Implement some method of LLM KV Cache Sparsity☆42Jun 6, 2024Updated 2 years ago
Are these results useful?