BorealisAI / efficient-vit-trainingLinks
PyTorch code of "Training a Vision Transformer from scratch in less than 24 hours with 1 GPU" (HiTY workshop at Neurips 2022)
☆22Updated last year
Alternatives and similar repositories for efficient-vit-training
Users that are interested in efficient-vit-training are comparing it to the libraries listed below
Sorting:
- an implementation of FAdam (Fisher Adam) in PyTorch☆47Updated 2 weeks ago
- Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch☆89Updated 4 months ago
- Implementation of a modular, high-performance, and simplistic mamba for high-speed applications☆36Updated 8 months ago
- Implementation of a Light Recurrent Unit in Pytorch☆48Updated 9 months ago
- [EMNLP 2024] RWKV-CLIP: A Robust Vision-Language Representation Learner☆137Updated last month
- Official PyTorch implementation of "LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging" (ICML 2024)☆29Updated 11 months ago
- Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"☆25Updated 2 weeks ago
- Timm model explorer☆40Updated last year
- Official Pytorch Implementation of Self-emerging Token Labeling☆34Updated last year
- ML-Mamba: Efficient Multi-Modal Large Language Model Utilizing Mamba-2☆66Updated 7 months ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated 11 months ago
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆93Updated last year
- Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…☆107Updated 3 months ago
- This repository contains the pytorch code for our work IEEE ISBI 2024 paper "ConvLoRA and AdaBN Based Domain Adaptation via Self-Training…☆80Updated 9 months ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated last year
- Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"☆52Updated 5 months ago
- A simpler Pytorch + Zeta Implementation of the paper: "SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series…☆28Updated 8 months ago
- ☆47Updated last year
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆34Updated last year
- Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with…☆31Updated 3 months ago
- A Contrastive Learning Boost from Intermediate Pre-Trained Representations☆42Updated 9 months ago
- Autoregressive Image Generation☆32Updated last month
- ☆181Updated 9 months ago
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆65Updated last month
- non-official NoisyNN Implemnentation☆50Updated last year
- Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch☆25Updated 3 months ago
- SAM-CLIP module for use with Autodistill.☆15Updated last year
- TensorFlow implementation of "TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?"☆35Updated 3 years ago
- OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024☆60Updated 4 months ago
- The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"☆20Updated 7 months ago