IntelLabs / DyNAS-T

Related projects ⓘ

Alternatives and complementary repositories for DyNAS-T

• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated last year
• apple / learning-compressible-subspaces
  ☆18Updated 3 years ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆87Updated last month
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆30Updated 3 months ago
• lightmatter-ai / INT-FP-QSim
  Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.
  ☆43Updated last year
• NVlabs / COAT
  ☆32Updated this week
• IntelLabs / Hardware-Aware-Automated-Machine-Learning
  ☆22Updated this week
• BradMcDanel / sdgp
  ☆11Updated 2 years ago
• Sharath-girish / LilNetX
  Official PyTorch implementation of LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification
  ☆46Updated 2 years ago
• NVlabs / SMCP
  ☆20Updated 2 years ago
• NVlabs / EfficientDL
  ☆30Updated 5 months ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated last year
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆16Updated last week
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆19Updated 8 months ago
• MAC-AutoML / OMPQ
  ☆24Updated 2 years ago
• fmfi-compbio / admm-pruning
  ☆18Updated 4 months ago
• pprp / Pruner-Zero
  Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆74Updated 5 months ago
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆64Updated last week
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆26Updated 5 months ago
• VITA-Group / Structure-LTH
  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…
  ☆31Updated last year
• yaozhewei / HAP
  ☆42Updated 9 months ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• chenjoya / dropit
  DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)
  ☆30Updated last year
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆19Updated last week
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• gregorbachmann / scaling_mlps
  ☆51Updated 5 months ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆49Updated last month
• papers-submission / structured_transposable_masks
  Code for ICML 2021 submission
  ☆35Updated 3 years ago