PrincetonUniversity / multi_gpu_trainingLinks
☆333Updated 3 months ago
Alternatives and similar repositories for multi_gpu_training
Users that are interested in multi_gpu_training are comparing it to the libraries listed below
Sorting:
- Helpful tools and examples for working with flex-attention☆811Updated last week
- Example of how to use Weights & Biases on Slurm☆115Updated 2 years ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆207Updated last year
- Building blocks for foundation models.☆502Updated last year
- Annotated version of the Mamba paper☆482Updated last year
- Python 3.8+ toolbox for submitting jobs to Slurm☆1,443Updated 2 weeks ago
- ☆50Updated 11 months ago
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆382Updated last week
- TensorDict is a pytorch dedicated tensor container.☆927Updated this week
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆380Updated last month
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆514Updated 3 weeks ago
- Implementation of Diffusion Transformer (DiT) in JAX☆276Updated 11 months ago
- Tensors, for human consumption☆1,252Updated 2 weeks ago
- Code for our NeurIPS 2022 paper☆368Updated 2 years ago
- Reading list for research topics in state-space models☆292Updated last week
- For optimization algorithm research and development.☆518Updated this week
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆327Updated 5 months ago
- A simple command line tool to show GPU usage on a SLURM cluster☆109Updated last year
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆379Updated last year
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆319Updated 5 months ago
- Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch☆685Updated 6 months ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆438Updated 9 months ago
- ☆228Updated 3 months ago
- Implementation of https://srush.github.io/annotated-s4☆497Updated 2 years ago
- ☆185Updated 6 months ago
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆337Updated 11 months ago
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model☆590Updated 6 months ago
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆239Updated 3 months ago
- Run PyTorch in JAX. 🤝☆246Updated 3 months ago
- A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.☆741Updated last year