EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
☆83Jun 14, 2024Updated 2 years ago
Alternatives and similar repositories for EE-LLM
Users that are interested in EE-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)☆67Sep 28, 2024Updated 2 years ago
- A curated list of early exiting (LLM, CV, NLP, etc)☆74Aug 21, 2024Updated 2 years ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆379Jul 20, 2026Updated 3 months ago
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…☆74Jun 26, 2024Updated 2 years ago
- ☆11Dec 1, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official PyTorch implementation of "LGViT: Dynamic Early Exiting for Accelerating Vision Transformer" (ACM MM 2023)☆16Nov 18, 2024Updated last year
- Source code of "DISCO: Diversifying Sample Condensation for Efficient Model Evaluation"☆12Apr 7, 2026Updated 6 months ago
- Learning to Skip the Middle Layers of Transformers☆17Aug 7, 2025Updated last year
- ☆54Jul 18, 2024Updated 2 years ago
- [ACL 2026 main] DGPO: Distillation-Guided Policy Optimization for Preserving Agentic RAG Capabilities☆13Jul 26, 2026Updated 3 months ago
- ☆39Mar 9, 2026Updated 7 months ago
- Code for ACL2022 publication Transkimmer: Transformer Learns to Layer-wise Skim☆22Aug 21, 2022Updated 4 years ago
- ☆23Jan 18, 2021Updated 5 years ago
- LifeBench: A Benchmark for Long-Horizon Multi-Source Memory☆20Oct 26, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆32Nov 12, 2024Updated last year
- PolyMage is a domain-specific language and optimizing code generator for auto-parallelisation☆14Jul 15, 2016Updated 10 years ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆23Mar 15, 2024Updated 2 years ago
- Official source code for Time is Not Enough: Time-Frequency based Explanation for Time-Series Black-Box Models☆14Dec 5, 2024Updated last year
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆176Jun 20, 2024Updated 2 years ago
- Experiments with representation engineering☆14Feb 28, 2024Updated 2 years ago
- Advanced job scheduling simulator☆18Nov 6, 2023Updated 2 years ago
- GPGPU array on Vulkan☆17Jun 3, 2023Updated 3 years ago
- ☆52Jan 28, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆173Feb 15, 2025Updated last year
- A package based on Chebyshev approximation for accelerating large sparse eigenvalue computations using CUDA.☆12Jun 14, 2017Updated 9 years ago
- ☆15Feb 13, 2026Updated 8 months ago
- Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)☆415Apr 22, 2025Updated last year
- [NeurIPS 2024] Implementation of paper - D-LLM: A Token Adaptive Computing Resource Allocation Strategy for Large Language Models☆26Apr 9, 2025Updated last year
- ☆30Jul 22, 2024Updated 2 years ago
- The source code of the paper "WebUltron: An Ultimate Retriever on Webpages under the Model-centric Paradigm"☆12Mar 21, 2023Updated 3 years ago
- ☆16Sep 8, 2025Updated last year
- ☆24Aug 25, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [AAAI 2021] "ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques", Yuanxin Liu, Zheng Lin, Fengcheng Yuan☆14Oct 18, 2022Updated 4 years ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆280Aug 31, 2024Updated 2 years ago
- Code for "Multi-Object Discovery by Low-Dimensional Object Motion", ICCV 2023☆12Dec 4, 2023Updated 2 years ago
- Presentation software for nerds with smartphone remote control☆21Feb 24, 2020Updated 6 years ago
- Libraries for efficient and scalable group-structured dataset pipelines.☆25Jul 8, 2026Updated 3 months ago
- ☆52Sep 13, 2025Updated last year
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆1,305Jun 27, 2026Updated 4 months ago