xhzhao / PyTorch-MPI-DDP-example
PyTorch-MPI-DDP-example
☆17Updated 7 years ago
Alternatives and similar repositories for PyTorch-MPI-DDP-example:
Users that are interested in PyTorch-MPI-DDP-example are comparing it to the libraries listed below
- A Chainer extension for K-FAC☆20Updated 5 years ago
- PyProf2: PyTorch Profiling tool☆82Updated 4 years ago
- Distributed Learning by Pair-Wise Averaging☆52Updated 7 years ago
- Distributed K-FAC Preconditioner for PyTorch☆85Updated last week
- Discrete Object Generation with Reversible Inductive Construction (NeurIPS 2019)☆30Updated 4 years ago
- Deep learning with a multiplication budget☆47Updated 6 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- CUDA kernels for generalized matrix-multiplication in PyTorch☆79Updated 3 years ago
- Regularization, Neural Network Training Dynamics☆14Updated 5 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated last month
- Block-sparse primitives for PyTorch☆154Updated 4 years ago
- Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations☆20Updated 2 years ago
- Code for "Efficient optimization of loops and limits with randomized telescoping sums"☆27Updated 5 years ago
- complex tensor plugin for pytorch (deprecated)☆47Updated 6 years ago
- Code for "Accelerating Natural Gradient with Higher-Order Invariance"☆30Updated 5 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 5 years ago
- Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."☆22Updated 5 years ago
- Autoregressive Energy Machines☆77Updated 2 years ago
- ☆74Updated 5 years ago
- ☆133Updated 7 years ago
- Butterfly matrix multiplication in PyTorch☆169Updated last year
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- implement distributed machine learning with Pytorch + OpenMPI☆51Updated 6 years ago
- A PyTorch implementation of the paper "Decoupled Parallel Backpropagation with Convergence Guarantee"☆29Updated 6 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- Profile the GPU memory usage of every line in a Pytorch code☆82Updated 6 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆75Updated 9 months ago
- Experiment code for "Randomized Automatic Differentiation"☆67Updated 4 years ago
- Einsum optimization using opt_einsum and PyTorch FX graph rewriting☆21Updated 3 years ago
- Feasible target propagation code for the paper "Deep Learning as a Mixed Convex-Combinatorial Optimization Problem" by Friesen & Domingos…☆28Updated 7 years ago