Official implementation of the ICLR paper "Streamlining Redundant Layers to Compress Large Language Models"
☆45May 1, 2025Updated last year
Alternatives and similar repositories for LLM-Streamline
Users that are interested in LLM-Streamline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2024] Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆44Feb 4, 2025Updated last year
- ☆46Jun 14, 2026Updated 4 months ago
- Official implementation for LaCo (EMNLP 2024 Findings)☆22Oct 3, 2024Updated 2 years ago
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆51Apr 9, 2024Updated 2 years ago
- Are gradient information useful for pruning of LLMs?☆48Aug 23, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [NAACL' 25 main] Lillama: Large Language Model Compression via Low-Rank Feature Distillation☆11Apr 10, 2025Updated last year
- A block pruning framework for LLMs.☆28May 17, 2025Updated last year
- ☆25Jul 23, 2026Updated 3 months ago
- ☆13Aug 29, 2025Updated last year
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆71Mar 27, 2025Updated last year
- Structured Pruning Adapters in PyTorch☆20Aug 30, 2023Updated 3 years ago
- A Model Agnostic function to directly remove specified layers from the LLM☆11May 23, 2024Updated 2 years ago
- [AAAI 2025] PAT: Pruning-Aware Tuning for Large Language Models☆38Feb 1, 2025Updated last year
- Accurate Retraining-free Pruning for Pretrained Encoder-based Language Models (ICLR 2024)☆14May 31, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆14Oct 20, 2026Updated last week
- Official Implementation of ACL 2025 paper "GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Check…☆22May 30, 2025Updated last year
- A sample pattern for running CI tests on Modal☆21Apr 12, 2025Updated last year
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆269Apr 23, 2024Updated 2 years ago
- A simple and effective LLM pruning approach.☆882Aug 9, 2024Updated 2 years ago
- torch_remat fine-grained activation checkpointing API☆23Updated this week
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year
- [NeurIPS 2024] Search for Efficient LLMs☆16Jan 16, 2025Updated last year
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆309Aug 28, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications☆52Oct 30, 2025Updated 11 months ago
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆49Jun 4, 2024Updated 2 years ago
- This repo contains the code for studying the interplay between quantization and sparsity methods☆26Feb 26, 2025Updated last year
- Repo for EmbedLLM: Learning Compact Representations of Large Language Models☆34Sep 25, 2025Updated last year
- An unofficial re-implementation of Graph Structure of Neural Networks (Jiaxuan You · Kaiming He · Jure Leskovec · Saining Xie) ICML 2020☆10Jul 27, 2020Updated 6 years ago
- ☆12Jan 12, 2024Updated 2 years ago
- ☆12Jul 22, 2026Updated 3 months ago
- An Attentive Graph Agent for Topology-Adaptive Cyber Defence☆11Jan 12, 2026Updated 9 months ago
- ☆23Nov 26, 2025Updated 11 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Awesome list for LLM pruning.☆296Oct 11, 2025Updated last year
- A framework for efficient model inference with omni-modality models☆30Oct 20, 2026Updated last week
- Official implementation of "Can Text-to-Video Generation help Video-Language Alignment?", CVPR 2025☆11Jun 15, 2025Updated last year
- Pruning applied to Facial Recognition.☆14Jun 19, 2019Updated 7 years ago
- Code for the AAAI-21 paper "Fairness in Influence Maximization through Randomization"☆10Mar 2, 2021Updated 5 years ago
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated last year
- Official implementation of the paper "Influence Maximization in Hypergraph Networks using Multi-Objective Evolutionary Algorithm".☆10Jun 6, 2024Updated 2 years ago