[COLM 2025] DEL: Context-Aware Dynamic Exit Layer for Efficient Self-Speculative Decoding
☆11May 11, 2026Updated 5 months ago
Alternatives and similar repositories for DEL
Users that are interested in DEL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆379Jul 20, 2026Updated 3 months ago
- ☆13Jul 9, 2024Updated 2 years ago
- Mesh: A lightweight, distributed, relational network architecture for MPC☆12Apr 2, 2026Updated 6 months ago
- Greed is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation☆10May 20, 2021Updated 5 years ago
- [KDD 2025] The source code for UQABench☆12Aug 18, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Local DeepSearch (Advantage: Low Threshold): an implementation of Agentic RAG based on DeepSeek-R1 API and Tavily API☆18Jun 21, 2025Updated last year
- placeholder☆12Jan 31, 2025Updated last year
- ☆16Aug 5, 2021Updated 5 years ago
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…☆74Jun 26, 2024Updated 2 years ago
- This project explores training data extraction attacks on the LLaMa 7B, GPT-2XL, and GPT-2-IMDB models to discover memorized content usin…☆15Jun 15, 2023Updated 3 years ago
- Curated list of open Call-for-Papers in SE/PL scientific conferences: we keep an eye on all of them!☆21Updated this week
- [ICML 2025] AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism☆20Jul 14, 2025Updated last year
- Efficient Inference for Large Language Model-based Generative Recommendation (ICLR'25)☆14May 27, 2025Updated last year
- Oversubscription of GPU Memory through Transparent Swapping☆15Mar 27, 2015Updated 11 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AdaptiveStep: Automatically Dividing Reasoning Step through Model Confidence☆11Mar 2, 2025Updated last year
- KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation☆24Nov 3, 2024Updated last year
- Correlated Low-rank Structure (CoLR) for Federated Recommendation System☆13May 31, 2026Updated 5 months ago
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆70Feb 21, 2025Updated last year
- UCB-CS61C project3 : RISC-V CPU design☆12Mar 19, 2023Updated 3 years ago
- Course project for UCB-CS168☆18Jun 8, 2025Updated last year
- MLOT - A machine learning algorithm, written for use with MATLAB, in order to track in 3D moving particles based on a training data set. …☆12Dec 24, 2018Updated 7 years ago
- The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"☆17Mar 17, 2025Updated last year
- ☆14Nov 7, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆17Updated this week
- Course planning service for SJTU☆24Apr 1, 2026Updated 7 months ago
- Forecasting library in python☆13Sep 6, 2019Updated 7 years ago
- A simple implementation of DP-RAG☆21Mar 17, 2025Updated last year
- The speculative decoding for uav environment☆17Oct 18, 2025Updated last year
- lanmt ebm☆12Jun 19, 2020Updated 6 years ago
- AutoWeka for python☆29May 13, 2014Updated 12 years ago
- MySQL 45道练习题☆12Mar 26, 2019Updated 7 years ago
- Queue OpenCode input until the current session is idle☆27Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Nov 6, 2020Updated 5 years ago
- ☆16Jan 14, 2025Updated last year
- Pyramidal Recurrent Units (PRUs): A New LSTM Unit☆10Aug 29, 2018Updated 8 years ago
- Herald: Accelerating Neural Recommendation Training with Embedding Scheduling (NSDI 2024)☆24May 9, 2024Updated 2 years ago
- ☆17May 3, 2024Updated 2 years ago
- Pgkit - Backup, PITR and recovery management made easy☆35Oct 11, 2023Updated 3 years ago
- [TDSC 2024] Official code for our paper "FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model"☆23May 14, 2025Updated last year