UbiquitousLearning / Efficient_Foundation_Model_SurveyLinks
Survey Paper List - Efficient LLM and Foundation Models
β257Updated last year
Alternatives and similar repositories for Efficient_Foundation_Model_Survey
Users that are interested in Efficient_Foundation_Model_Survey are comparing it to the libraries listed below
Sorting:
- a curated list of high-quality papers on resource-efficient LLMs π±β149Updated 8 months ago
- β101Updated last year
- [TKDE'25] The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".β454Updated 4 months ago
- Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.β134Updated 3 months ago
- Awesome list for LLM pruning.β274Updated last month
- Awesome-LLM-KV-Cache: A curated list of πAwesome LLM KV Cache Papers with Codes.β392Updated 8 months ago
- π° Must-read papers on KV Cache Compression (constantly updating π€).β608Updated last month
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Lengthβ131Updated last month
- Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**β210Updated 9 months ago
- A curated list of early exiting (LLM, CV, NLP, etc)β68Updated last year
- Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)β336Updated 7 months ago
- This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding coβ¦β248Updated 4 months ago
- [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.β488Updated last year
- Efficient Mixture of Experts for LLM Paper Listβ144Updated 2 months ago
- β61Updated 11 months ago
- Curated collection of papers in MoE model inferenceβ307Updated last month
- Awesome list for LLM quantizationβ359Updated last month
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".β94Updated 2 years ago
- β347Updated last year
- [ICMLβ24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".β117Updated 4 months ago
- EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).β71Updated last year
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".β48Updated last year
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)β67Updated 8 months ago
- β88Updated 3 years ago
- [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Modelsβ63Updated last year
- Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inferenceβ47Updated last year
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitinβ¦β63Updated last year
- β82Updated last year
- β290Updated 4 months ago
- β43Updated last year