olehb / pytorch_ddp_tutorialLinks
A step-by-step tutorial about how to use Distributed Data Parallel feature of PyTorch
☆16Updated 5 years ago
Alternatives and similar repositories for pytorch_ddp_tutorial
Users that are interested in pytorch_ddp_tutorial are comparing it to the libraries listed below
Sorting:
- CLASP - Contrastive Language-Aminoacid Sequence Pretraining☆143Updated 4 years ago
- Research code for pixel-based encoders of language (PIXEL)☆345Updated 6 months ago
- Implementation of Fast Transformer in Pytorch☆177Updated 4 years ago
- Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch☆355Updated 2 years ago
- ☆149Updated last year
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆150Updated 4 years ago
- A PyTorch Lightning solution to training OpenAI's CLIP from scratch.☆719Updated 3 years ago
- Axial Positional Embedding for Pytorch☆84Updated 11 months ago
- Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch☆231Updated last year
- Simple python template☆42Updated last year
- ☆160Updated 3 years ago
- Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint☆424Updated last year
- [NeurIPS 2022] Official PyTorch implementation of Optimizing Relevance Maps of Vision Transformers Improves Robustness. This code allows …☆133Updated 3 years ago
- Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.☆413Updated 6 months ago
- Language Models Can See: Plugging Visual Controls in Text Generation☆259Updated 3 years ago
- Implementation of Self-conditioned Embedding Diffusion for Text Generation☆38Updated 3 years ago
- ☆163Updated 7 months ago
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆181Updated 2 years ago
- ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models☆339Updated last year
- An unofficial implementation of both ViT-VQGAN and RQ-VAE in Pytorch☆321Updated 9 months ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆120Updated 4 years ago
- Code release for "Dropout Reduces Underfitting"☆316Updated 2 years ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆80Updated 3 weeks ago
- A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!☆112Updated 2 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆444Updated last year
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆98Updated 2 years ago
- Code for paper LAFITE: Towards Language-Free Training for Text-to-Image Generation (CVPR 2022)☆183Updated 2 years ago
- The official codebase for "Empowering Diffusion Models on the Embedding Space for Text Generation" (NAACL 2024)☆55Updated last year
- ☆123Updated 2 years ago
- Reparameterized Discrete Diffusion Models for Text Generation☆104Updated 2 years ago