DACUS1995 / pytorch-mmap-datasetLinks
A custom pytorch Dataset extension that provides a faster iteration and better RAM usage
☆44Updated last year
Alternatives and similar repositories for pytorch-mmap-dataset
Users that are interested in pytorch-mmap-dataset are comparing it to the libraries listed below
Sorting:
- several types of attention modules written in PyTorch for learning purposes☆54Updated 9 months ago
- ☆33Updated last month
- ☆8Updated last year
- ☆16Updated 2 years ago
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated last year
- PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems☆32Updated 11 months ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆39Updated 3 years ago
- PyTorch implementation of Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation☆28Updated 3 years ago
- The accompanying code for "Memory-efficient Transformers via Top-k Attention" (Ankit Gupta, Guy Dar, Shaya Goodman, David Ciprut, Jonatha…☆69Updated 3 years ago
- Official PyTorch implementation of LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification☆46Updated 3 years ago
- ☆31Updated last year
- PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)☆75Updated last year
- Utilities for Training Very Large Models☆58Updated 9 months ago
- ViT trained on COYO-Labeled-300M dataset☆32Updated 2 years ago
- # Unified Normalization (ACM MM'22) By Qiming Yang, Kai Zhang, Chaoxiang Lan, Zhi Yang, Zheyang Li, Wenming Tan, Jun Xiao, and Shiliang P…☆34Updated 2 years ago
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆58Updated last year
- A simple implementation of [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://arxiv.org/abs/2312.00752)☆22Updated last year
- Implementation of the Remixer Block from the Remixer paper, in Pytorch☆36Updated 3 years ago
- Experimental scripts for researching data adaptive learning rate scheduling.☆23Updated last year
- Implementation of Multistream Transformers in Pytorch☆54Updated 3 years ago
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆129Updated 7 months ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated 2 years ago
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆48Updated 2 years ago
- ☆41Updated 4 years ago
- The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"☆20Updated 7 months ago
- A repository for DenseSSMs☆87Updated last year
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated last year
- State Space Models☆68Updated last year
- Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).☆25Updated last year
- A dashboard for exploring timm learning rate schedulers☆19Updated 7 months ago