tmbdev-archive / webdataset-examplesLinks
Examples for the WebDataset PyTorch Dataset Library
☆51Updated 4 years ago
Alternatives and similar repositories for webdataset-examples
Users that are interested in webdataset-examples are comparing it to the libraries listed below
Sorting:
- A small demonstration of using WebDataset with ImageNet and PyTorch Lightning☆76Updated 2 years ago
- An unopinionated replacement for PyTorch's Dataset and ImageFolder, that handles Tar archives☆78Updated 3 years ago
- Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.☆133Updated 2 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 3 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆219Updated 2 years ago
- This is the official PyTorch implementation for "Mesa: A Memory-saving Training Framework for Transformers".☆121Updated 4 years ago
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 3 years ago
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆98Updated 4 years ago
- A small repository demonstrating the use of Webdataset and Imagenet☆17Updated 2 years ago
- An open source implementation of CLIP.☆33Updated 3 years ago
- ImageNet-12k subset of ImageNet-21k (fall11)☆21Updated 2 years ago
- JAX implementation ViT-VQGAN☆82Updated 3 years ago
- A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.☆142Updated 4 years ago
- ☆107Updated 4 years ago
- PyTorch implementation of IRMAE https//arxiv.org/abs/2010.00679☆48Updated 3 years ago
- Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371.☆182Updated 3 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆51Updated 3 years ago
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated 2 years ago
- Online Normalization for Training Neural Networks (Companion Repository)☆86Updated 4 years ago
- ☆25Updated 4 years ago
- Hacks for PyTorch☆19Updated 2 years ago
- A simple minimal implementation of Reversible Vision Transformers☆126Updated last year
- Code and models for the paper "The effectiveness of MAE pre-pretraining for billion-scale pretraining" https://arxiv.org/abs/2303.13496☆92Updated 9 months ago
- understanding model mistakes with human annotations☆106Updated 2 years ago
- Implementation of Fast Transformer in Pytorch☆177Updated 4 years ago
- Implementation of LogAvgExp for Pytorch☆37Updated 9 months ago
- ☆56Updated 2 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆131Updated 3 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆99Updated 5 years ago
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated 2 years ago