subramen / minGPT-ddp
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
☆20Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for minGPT-ddp
- Transformers w/o Attention, based fully on MLPs☆89Updated 7 months ago
- ☆49Updated last year
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆19Updated 2 years ago
- Recent Advances on Efficient Vision Transformers☆48Updated last year
- ☆170Updated last month
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 2 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆66Updated 2 years ago
- ☆23Updated 4 months ago
- ☆30Updated 5 months ago
- Megatron's multi-modal data loader☆138Updated this week
- Examples for the WebDataset PyTorch Dataset Library☆47Updated 3 years ago
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆19Updated 2 weeks ago
- Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"☆97Updated 2 months ago
- Official PyTorch implementation of MaskSub "Masking Augmentation for Supervised Learning"☆34Updated 8 months ago
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆217Updated last month
- Patch convolution to avoid large GPU memory usage of Conv2D☆79Updated 5 months ago
- ☆39Updated 3 weeks ago
- [CVPR'23] SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer☆61Updated 7 months ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆36Updated 8 months ago
- [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…☆40Updated last year
- A simple minimal implementation of Reversible Vision Transformers☆117Updated 8 months ago
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆69Updated 2 years ago
- Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).☆20Updated 5 months ago
- DeltaCNN End-to-End CNN Inference of Sparse Frame Differences in Videos☆60Updated last year
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"☆29Updated 3 months ago
- torch_quantizer is a out-of-box quantization tool for PyTorch models on CUDA backend, specially optimized for Diffusion Models.☆19Updated 7 months ago
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆104Updated last year
- Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…☆42Updated last year
- ☆39Updated 3 years ago
- code for NASViT☆66Updated 2 years ago