Alternatives and similar repositories for DyNAS-T:

Users that are interested in DyNAS-T are comparing it to the libraries listed below

• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated last year
• apple / learning-compressible-subspaces
  ☆19Updated 3 years ago
• NVlabs / EfficientDL
  ☆31Updated 7 months ago
• NVlabs / COAT
  ☆52Updated last week
• AamirRaihan / SWAT
  Official implementation of Neurips 2020 "Sparse Weight Activation Training" paper.
  ☆27Updated 3 years ago
• facebookresearch / Ternary_Binary_Transformer
  ACL 2023
  ☆38Updated last year
• NVlabs / SMCP
  ☆20Updated 2 years ago
• chenjoya / dropit
  DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)
  ☆30Updated last year
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆28Updated 7 months ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆32Updated 5 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆81Updated 7 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 10 months ago
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆19Updated 2 years ago
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆37Updated last year
• indri-voice / vit.triton
  VIT inference in triton because, why not?
  ☆22Updated 7 months ago
• Sharath-girish / LilNetX
  Official PyTorch implementation of LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification
  ☆46Updated 2 years ago
• Qualcomm-AI-research / lr-qat
  ☆26Updated 2 months ago
• HayeonLee / HELP
  Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight…
  ☆60Updated 5 months ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆44Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated 3 months ago
• facebookresearch / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆71Updated 2 years ago
• facebookresearch / bit
  Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer
  ☆103Updated last year
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆19Updated 3 weeks ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆67Updated 7 months ago
• ziplab / EcoFormer
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
  ☆69Updated 2 years ago
• yaozhewei / HAP
  ☆43Updated 11 months ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• facebookresearch / DeltaCNN
  DeltaCNN End-to-End CNN Inference of Sparse Frame Differences in Videos
  ☆60Updated last year
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated last year
• papers-submission / structured_transposable_masks
  Code for ICML 2021 submission
  ☆35Updated 3 years ago