An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.
☆25Aug 6, 2025Updated last year
Alternatives and similar repositories for DISP-LLM-Dimension-Independent-Structural-Pruning
Users that are interested in DISP-LLM-Dimension-Independent-Structural-Pruning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Oct 9, 2023Updated 3 years ago
- [ICLR 2025] Probe Pruning: Accelerating LLMs through Dynamic Pruning via Model-Probing☆12May 11, 2026Updated 5 months ago
- Official Pytorch Implementation of Paper "DarwinLM: Evolutionary Structured Pruning of Large Language Models"☆21Feb 21, 2025Updated last year
- [TMLR] Offical Implementation of ToMoE: ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pr…☆42Aug 27, 2026Updated 2 months ago
- Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition☆21Apr 16, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆30Jul 22, 2024Updated 2 years ago
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆65Apr 6, 2025Updated last year
- [AAAI 2025] PAT: Pruning-Aware Tuning for Large Language Models☆38Feb 1, 2025Updated last year
- [ICLR 2025] Systematic Outliers in Large Language Models.☆11Feb 11, 2025Updated last year
- ☆35May 24, 2024Updated 2 years ago
- CREST is a training-free test-time steering framework that discovers cognitive heads via simple offline calibration and then rotates acti…☆12Oct 22, 2026Updated 2 weeks ago
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆71Mar 27, 2025Updated last year
- A paper list shared in the group meeting☆13Nov 13, 2025Updated 11 months ago
- Performs a faster tensor train (TT) decomposition for large sparse data☆14Sep 7, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing (WACV 2025)☆13Feb 7, 2026Updated 9 months ago
- This is an official implementation for "Unified Low-rank Compression Framework for Click-through Rate Prediction".☆11May 29, 2024Updated 2 years ago
- [NeurIPS 2025@FoRLM] R1-Compress: Long Chain-of-Thought Compression via Chunk Compression and Search☆17Jan 24, 2026Updated 9 months ago
- codebase for Coruscant: Co-Designing GPU Kernel and Sparse Tensor Core to Advocate Unstructured Sparsity in Efficient LLM Inference☆11Oct 17, 2025Updated last year
- Implementation of NM sparsity recipe presented in the paper "Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers".☆11Feb 5, 2024Updated 2 years ago
- For releasing code related to compression methods for transformers, accompanying our publications☆466Sep 10, 2026Updated 2 months ago
- 关于AI,ML,DA,DV等的几个经典案例，包括堵车模拟(NagelSchreckenberg)、蒙特卡洛排队问题(Monte Carlo Queuing Problem)、人脸识别(RecognitionFace)、遗传算法推断图像(IconGenetic)☆10Oct 14, 2018Updated 8 years ago
- Pytorch implementation of our paper accepted by ICML 2023 -- "Bi-directional Masks for Efficient N:M Sparse Training"☆14Jun 7, 2023Updated 3 years ago
- Pytorch implementation of paper: Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization.☆12May 18, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This is the official repo for "Differentiable Model Scaling using Differentiable Topk"☆12May 16, 2024Updated 2 years ago
- Structured Pruning Adapters in PyTorch☆20Aug 30, 2023Updated 3 years ago
- Official repository for the paper: "Trees with Attention for Set Prediction Tasks" (ICML21)☆10Jan 19, 2022Updated 4 years ago
- Learning to share: simultaneous parameter tying and sparsification in deep learning☆13Aug 21, 2018Updated 8 years ago
- ☆10Jan 30, 2017Updated 9 years ago
- vortex particles for simulating smoke in 2d☆17Dec 13, 2021Updated 4 years ago
- Pipelined Processor which implements RV32i Instruction Set. Also contains pipelined L1 4-way set-associative Instruction Cache, direct-ma…☆15Dec 23, 2022Updated 3 years ago
- A curated list of Parameter Efficient Fine-tuning papers with a TL;DR☆13Sep 19, 2024Updated 2 years ago
- ☆11Nov 27, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 中科大郑启龙2021年并行程序设计课程实验☆11Jan 15, 2022Updated 4 years ago
- Official Repository for "WUSH: Near-Optimal Adaptive Transforms for LLM Quantization" (ICML 2026)☆18Jun 30, 2026Updated 4 months ago
- Official Code of The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks[ICML2022]☆16Sep 20, 2022Updated 4 years ago
- A Curated List of Resources for Diffusion LLMs☆14Oct 8, 2025Updated last year
- [ICLR 2026] Offical implementation of "OBS-Diff".☆67Mar 5, 2026Updated 8 months ago
- ☆14May 7, 2019Updated 7 years ago
- Code for Learned Thresholds Token Merging and Pruning for Vision Transformers (LTMP). A technique to reduce the size of Vision Transforme…☆17Nov 24, 2024Updated last year
Are these results useful?