☆64Oct 17, 2023Updated 3 years ago
Alternatives and similar repositories for LoSparse
Users that are interested in LoSparse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of Language model compression with weighted low-rank factorization☆14Jun 28, 2023Updated 3 years ago
- A paper list shared in the group meeting☆13Nov 13, 2025Updated 11 months ago
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated last year
- [ICLR'25] R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference☆21Apr 28, 2025Updated last year
- [ICML 2024]: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models☆11May 19, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"☆43Aug 23, 2026Updated 2 months ago
- Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition☆21Apr 16, 2025Updated last year
- ☆62Jun 10, 2024Updated 2 years ago
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆95Oct 22, 2024Updated 2 years ago
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆33Feb 18, 2026Updated 8 months ago
- Compressing Large Language Models using Low Precision and Low Rank Decomposition☆111Nov 24, 2025Updated 11 months ago
- Implementation of RankE: End-to-End Discrete Text-to-Image Post-Training via Rank-Consistent Alignment☆21May 27, 2026Updated 5 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆101Sep 4, 2024Updated 2 years ago
- Official implementation for LaCo (EMNLP 2024 Findings)☆22Oct 3, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆39Nov 1, 2024Updated 2 years ago
- Official implementation of ICML'24 paper "LQER: Low-Rank Quantization Error Reconstruction for LLMs"☆19Jul 11, 2024Updated 2 years ago
- ☆26Nov 23, 2023Updated 2 years ago
- Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".☆902Aug 20, 2024Updated 2 years ago
- Low-Rank Llama Custom Training☆23Mar 27, 2024Updated 2 years ago
- [ICML 2024] Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆44Feb 4, 2025Updated last year
- Official Code of The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks[ICML2022]☆16Sep 20, 2022Updated 4 years ago
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 5 years ago
- Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"☆33May 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆71Mar 27, 2025Updated last year
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆51Apr 9, 2024Updated 2 years ago
- Webpage: https://chuny9743.github.io/AI4WaterEnv_Webpage/☆36Aug 22, 2026Updated 2 months ago
- Official repository for the paper: "You Only Prune Once: Designing Calibration-Free Model Compression With Policy Learning" [ICLR 2025]☆10Apr 13, 2025Updated last year
- ☆23Nov 26, 2024Updated last year
- PyTorch implementation of "Sample- and Parameter-Efficient Auto-Regressive Image Models" from CVPR 2025☆14Nov 21, 2025Updated 11 months ago
- Versatile Toolbox Package☆10Nov 28, 2022Updated 3 years ago
- This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).☆45Oct 17, 2022Updated 4 years ago
- [TMLR 2026] Is Oracle Pruning the True Oracle?☆35Jul 1, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code to reproduce the experiments of the ICLR24-paper: "Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging"☆12Oct 14, 2025Updated last year
- ☆11Mar 14, 2024Updated 2 years ago
- [arxiv 2025] SparseSSM: Efficient Selective Structured State Space Models Can Be Pruned in One-Shot☆22Oct 8, 2025Updated last year
- On the Effectiveness of Parameter-Efficient Fine-Tuning☆39Nov 4, 2023Updated 2 years ago
- Code for SALT: Stackelberg Adversarial Regularization, EMNLP 2021.☆14Sep 23, 2021Updated 5 years ago
- ☆15Nov 7, 2024Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆28Jul 13, 2023Updated 3 years ago