Alternatives and similar repositories for Awesome-Tensor-Decomposition

Users that are interested in Awesome-Tensor-Decomposition are comparing it to the libraries listed below

• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆66Updated 10 months ago
• colehawkins / bayesian-tensor-rank-determination
  ☆13Updated 3 years ago
• zoq / Awesome-Optimizer
  Collect optimizer related papers, data, repositories
  ☆97Updated 9 months ago
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆115Updated 7 months ago
• yifanycc / loretta
  [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
  ☆36Updated 7 months ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆110Updated last month
• hrcheng1066 / awesome-pruning
  ☆270Updated last year
• Qualcomm-AI-research / outlier-free-transformers
  ☆44Updated last year
• imagination-research / EEP
  Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs
  ☆18Updated 8 months ago
• parsa-epfl / quantization-sparsity-interplay
  This repo contains the code for studying the interplay between quantization and sparsity methods
  ☆22Updated 6 months ago
• IST-DASLab / EvoPress
  ☆26Updated last month
• Yanjun-Zhao / HiZOO
  Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
  ☆17Updated 6 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆33Updated 9 months ago
• biomedical-cybernetics / Relative-importance-and-activation-pruning
  ☆50Updated last year
• quanta-fine-tuning / quanta
  (NeurIPS 2024) QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation
  ☆30Updated 9 months ago
• WeiHuang05 / Awesome_Large_Foundation_Model_Theory
  Welcome to the 'In Context Learning Theory' Reading Group
  ☆30Updated 9 months ago
• stephenqz / OATS
  Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition
  ☆13Updated 4 months ago
• HazyResearch / fly
  ☆213Updated 2 years ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated last year
• GATECH-EIC / AmoebaLLM
  [NeurIPS 2024] "AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment" by Yonggan Fu, Zhongzhi Yu,…
  ☆16Updated 8 months ago
• wangqinsi1 / Dobi-SVD
  Official code implementation for 2025 ICLR accepted paper "Dobi-SVD : Differentiable SVD for LLM Compression and Some New Perspectives"
  ☆39Updated 5 months ago
• luuyin / OWL
  Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"
  ☆73Updated last month
• rain-neuromorphics / energy-based-learning
  Code to simulate energy-based analog systems and equilibrium propagation
  ☆29Updated 4 months ago
• ghimiredhikura / Awasome-Pruning
  Awasome Papers and Resources in Deep Neural Network Pruning with Source Code.
  ☆166Updated last year
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆224Updated last year
• philip-bl / tensorizing_neural_networks-novikov_2015
  MNIST experiment from Tensorizing neural networks (Novikov et al. 2015)
  ☆13Updated 5 years ago
• thu-ml / Jetfire-INT8Training
  ☆51Updated last year
• yxli2123 / LoSparse
  ☆59Updated last year
• epfml / optML-pku
  summer school materials
  ☆44Updated 2 years ago
• liyunqianggyn / Awesome-LLMs-Pruning
  Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.
  ☆116Updated 3 weeks ago