davidrpugh / horovod-gpu-data-science-project
Template repository for a Python 3-based data science project that uses Horovod.
☆43Updated 3 years ago
Alternatives and similar repositories for horovod-gpu-data-science-project:
Users that are interested in horovod-gpu-data-science-project are comparing it to the libraries listed below
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- A Machine Learning workflow for Slurm.☆149Updated 4 years ago
- ☆36Updated 3 years ago
- a lightweight transformer library for PyTorch☆71Updated 3 years ago
- Collection of snippets for PyTorch users☆25Updated 2 years ago
- High performance pytorch modules☆18Updated 2 years ago
- ☆25Updated 3 years ago
- Companion code for a tutorial on using Hydra.☆29Updated 3 years ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Updated 3 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆102Updated 3 years ago
- Code for the anonymous submission "Cockpit: A Practical Debugging Tool for Training Deep Neural Networks"☆31Updated 4 years ago
- Simply Numpy implementation of the FAVOR+ attention mechanism, https://teddykoker.com/2020/11/performers/☆37Updated 4 years ago
- A small demonstration of using WebDataset with ImageNet and PyTorch Lightning☆74Updated last year
- NeurIPS 2021 - Few-shot learning competition☆26Updated 3 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 4 years ago
- Integrate pytorch☆46Updated 3 years ago
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Updated 4 years ago
- ☆19Updated 3 years ago
- Automate issue discovery for your projects against Lightning nightly and releases.☆45Updated last week
- Semantic Segmentation with Pytorch-Lightning☆63Updated 4 years ago
- ☆18Updated 3 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- ☆54Updated last year
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆49Updated last year
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆60Updated 3 years ago
- A set of useful tools for DL experiments, project templates, etc.☆35Updated 3 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Implémentation of the article **Deep Learning CUDA Memory Usage and Pytorch optimization tricks**☆43Updated 5 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆24Updated 2 years ago
- Block-sparse primitives for PyTorch☆153Updated 3 years ago