Alternatives and similar repositories for Octo:

Users that are interested in Octo are comparing it to the libraries listed below

• ParCIS / Ok-Topk
  Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…
  ☆24Updated 2 years ago
• gilshm / sparq
  Post-training sparsity-aware quantization
  ☆34Updated last year
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆41Updated 5 months ago
• sjtu-epcc / DVABatch
  ☆18Updated 2 years ago
• lzhangbv / acpsgd
  [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
  ☆10Updated last year
• lusinlu / deep-gradient-compression
  Partial implementation of paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING"
  ☆31Updated 4 years ago
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆34Updated 2 years ago
• bibikar / feddst
  Federated Dynamic Sparse Training
  ☆29Updated 2 years ago
• Soroosh129 / NeuOS
  Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"
  ☆21Updated 4 years ago
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆55Updated 3 years ago
• Tabrizian / learning-to-quantize
  Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.
  ☆29Updated 4 years ago
• yanring / DGS
  Dual-way gradient sparsification approach for async DNN training, based on PyTorch.
  ☆11Updated 2 years ago
• PatrickGuo / Mistify
  ☆10Updated 3 years ago
• xinyandai / gradient-quantization
  vector quantization for stochastic gradient descent.
  ☆33Updated 4 years ago
• CompML / survey-deep-gradient-compression
  ☆10Updated 3 years ago
• yeshaokai / ADMM-NN
  ☆36Updated 5 years ago
• NiuChaoyue / Secure-Federated-Submodel-Learning
  ☆14Updated 3 years ago
• qipengwang / Melon
  MobiSys#114
  ☆21Updated last year
• SamsungLabs / eagle
  Measuring and predicting on-device metrics (latency, power, etc.) of machine learning models
  ☆66Updated last year
• epfml / LocalSGD-Code
  ☆45Updated 4 years ago
• jmluu / Awesome-Efficient-Training
  A collection of research papers on efficient training of DNNs
  ☆69Updated 2 years ago
• mlpen / LookupFFN
  ☆16Updated 11 months ago
• chaoyanghe / FedNAS
  FedNAS: Federated Deep Learning via Neural Architecture Search
  ☆53Updated 3 years ago
• shams-sam / FedOptim
  Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?
  ☆14Updated 2 years ago
• iamkanghyunchoi / qimera
  Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples [NeurIPS 2021]
  ☆30Updated 3 years ago
• yanghr / BSQ
  BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)
  ☆38Updated 4 years ago
• GATECH-EIC / Double-Win-Quant
  [ICML 2021] "Double-Win Quant: Aggressively Winning Robustness of Quantized DeepNeural Networks via Random Precision Training and Inferen…
  ☆13Updated 3 years ago
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• elliothe / Neural_Network_Weight_Attack
  Changing several bit which overwhelms the quantized CNN
  ☆41Updated 5 years ago
• yaozhewei / HAP
  ☆43Updated last year