tmbdev-archive / webdataset-lightning
A small demonstration of using WebDataset with ImageNet and PyTorch Lightning
☆74Updated last year
Alternatives and similar repositories for webdataset-lightning:
Users that are interested in webdataset-lightning are comparing it to the libraries listed below
- Examples for the WebDataset PyTorch Dataset Library☆47Updated 3 years ago
- Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.☆127Updated last year
- An unopinionated replacement for PyTorch's Dataset and ImageFolder, that handles Tar archives☆77Updated 2 years ago
- ☆25Updated 3 years ago
- Configuration classes enabling Hydra to configure and manage Pytorch Lightning projects.☆42Updated 3 years ago
- An open source implementation of CLIP.☆32Updated 2 years ago
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆86Updated 3 years ago
- Implementation of LogAvgExp for Pytorch☆34Updated 3 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆127Updated 2 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆212Updated 2 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆98Updated 4 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆125Updated 3 years ago
- gpu tester detects broken and slow gpus in a cluster☆68Updated 2 years ago
- Online Normalization for Training Neural Networks (Companion Repository)☆81Updated 3 years ago
- ☆165Updated 6 years ago
- pytest plugin for a better developer experience when working with the PyTorch test suite☆44Updated 3 years ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- a lightweight transformer library for PyTorch☆71Updated 3 years ago
- Pytorch Lightning seed project with hydra☆18Updated 4 years ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆128Updated last year
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- PyProf2: PyTorch Profiling tool☆82Updated 4 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 4 years ago
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Updated 4 years ago
- ☆109Updated 3 years ago
- Exploiting Uncertainty of Loss Landscape for Stochastic Optimization☆15Updated 5 years ago
- High performance pytorch modules☆18Updated 2 years ago
- ☆62Updated 4 years ago
- Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch☆59Updated 4 years ago
- ☆25Updated 2 years ago