Alternatives and similar repositories for TinyTrain:

Users that are interested in TinyTrain are comparing it to the libraries listed below

• jmluu / Awesome-Efficient-Training
  A collection of research papers on efficient training of DNNs
  ☆70Updated 2 years ago
• iamkanghyunchoi / qimera
  Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples [NeurIPS 2021]
  ☆31Updated 3 years ago
• MAC-AutoML / OMPQ
  ☆25Updated 3 years ago
• GATECH-EIC / HW-NAS-Bench
  [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark
  ☆110Updated last year
• GATECH-EIC / ShiftAddViT
  [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
  ☆32Updated last year
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆46Updated last year
• GATECH-EIC / Double-Win-Quant
  [ICML 2021] "Double-Win Quant: Aggressively Winning Robustness of Quantized DeepNeural Networks via Random Precision Training and Inferen…
  ☆13Updated 3 years ago
• HayeonLee / HELP
  Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight…
  ☆62Updated 7 months ago
• Qualcomm-AI-research / oscillations-qat
  ☆75Updated 2 years ago
• hoonyyhoon / Synflow_SNIP_GraSP
  Comparison of method "Pruning at initialization prior to training" (Synflow/SNIP/GraSP) in PyTorch
  ☆15Updated 10 months ago
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆42Updated 6 months ago
• hmarkc / parallel-prompt-decoding
  Efficient LLM Inference Acceleration using Prompting
  ☆47Updated 4 months ago
• yaozhewei / HAP
  ☆43Updated last year
• boone891214 / MEST
  [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…
  ☆18Updated 2 years ago
• leeyeehoo / GenNAS
  Generic Neural Architecture Search via Regression (NeurIPS'21 Spotlight)
  ☆36Updated 2 years ago
• HuangOwen / Quantization-Variation
  [TMLR] Official PyTorch implementation of paper "Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precisio…
  ☆41Updated 5 months ago
• MingSun-Tse / Awesome-Pruning-at-Initialization
  [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.
  ☆59Updated last year
• snap-research / F8Net
  [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
  ☆94Updated 2 years ago
• kimihe / Octo
  Create tiny ML systems for on-device learning.
  ☆20Updated 3 years ago
• eliberis / uNAS
  μNAS is a neural architecture search (NAS) system that designs small-yet-powerful microcontroller-compatible neural networks.
  ☆79Updated 4 years ago
• zhexinli / Q-ViT-DeiT
  DeiT implementation for Q-ViT
  ☆25Updated 2 years ago
• aojunzz / DominoSearch
  ☆18Updated 3 years ago
• aiha-lab / MX-QLLM
  LLM Inference with Microscaling Format
  ☆19Updated 4 months ago
• hzf1174 / RoBoT
  Official Implementation of Robustifying and Boosting Training-Free Neural Architecture Search
  ☆11Updated last year
• lzhangbv / acpsgd
  [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
  ☆10Updated last year
• SHI-Labs / Any-Precision-DNNs
  Any-Precision Deep Neural Networks (AAAI 2021)
  ☆58Updated 4 years ago
• SLDGroup / ZiCo
  ☆25Updated last year
• VITA-Group / GraNet
  [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration
  ☆31Updated 2 years ago