GATECH-EIC / FracTrain
[NeurIPS 2020] "FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training" by Yonggan Fu, Haoran You, Yang Zhao, Yue Wang, Chaojian Li, Kailash Gopalakrishnan, Zhangyang Wang, Yingyan Lin
☆11Updated 2 years ago
Alternatives and similar repositories for FracTrain:
Users that are interested in FracTrain are comparing it to the libraries listed below
- Code for ICML 2021 submission☆35Updated 3 years ago
- BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)☆38Updated 4 years ago
- Official implementation of "Searching for Winograd-aware Quantized Networks" (MLSys'20)☆27Updated last year
- [ICML 2021] "Double-Win Quant: Aggressively Winning Robustness of Quantized DeepNeural Networks via Random Precision Training and Inferen…☆13Updated 2 years ago
- [ICML 2021] "Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators" by Yonggan Fu, Yonga…☆15Updated 3 years ago
- Simulator for BitFusion☆95Updated 4 years ago
- [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer☆32Updated last year
- A collection of research papers on efficient training of DNNs☆69Updated 2 years ago
- ☆17Updated last month
- BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.☆50Updated last year
- ☆31Updated 3 years ago
- Post-training sparsity-aware quantization☆34Updated last year
- TBNv2: Convolutional Neural Network With Ternary Inputs and Binary Weights☆17Updated 4 years ago
- AFP is a hardware-friendly quantization framework for DNNs, which is contributed by Fangxin Liu and Wenbo Zhao.☆12Updated 3 years ago
- Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs☆24Updated 7 months ago
- ☆17Updated 2 years ago
- ☆19Updated 3 years ago
- ☆43Updated last year
- PyTorch implementation of EdMIPS: https://arxiv.org/pdf/2004.05795.pdf☆57Updated 4 years ago
- Any-Precision Deep Neural Networks (AAAI 2021)☆57Updated 4 years ago
- ☆38Updated 2 years ago
- ☆90Updated last year
- Measuring and predicting on-device metrics (latency, power, etc.) of machine learning models☆66Updated last year
- ☆32Updated 4 years ago
- ☆74Updated 2 years ago
- mixed-precision quantization for LLMs☆19Updated last year
- [ICASSP'20] DNN-Chip Predictor: An Analytical Performance Predictor for DNN Accelerators with Various Dataflows and Hardware Architecture…☆23Updated 2 years ago
- Here are some implementations of basic hardware units in RTL language (verilog for now), which can be used for area/power evaluation and …☆10Updated last year
- Training with Block Minifloat number representation☆14Updated 3 years ago