soumik12345 / clip-lightningLinks
☆19Updated 3 years ago
Alternatives and similar repositories for clip-lightning
Users that are interested in clip-lightning are comparing it to the libraries listed below
Sorting:
- Implementation of Multistream Transformers in Pytorch☆54Updated 4 years ago
- An open source implementation of CLIP.☆33Updated 2 years ago
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆102Updated 2 years ago
- A dashboard for exploring timm learning rate schedulers☆19Updated 11 months ago
- Implementation of Fast Transformer in Pytorch☆177Updated 4 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆96Updated 2 years ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 3 years ago
- Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"☆122Updated 3 years ago
- JAX implementation ViT-VQGAN☆82Updated 3 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆51Updated 3 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆120Updated 4 years ago
- Implementation of a Light Recurrent Unit in Pytorch☆49Updated last year
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆39Updated 3 years ago
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆96Updated 3 years ago
- Official implementation of "Active Image Indexing"☆59Updated 2 years ago
- Cyclemoid implementation for PyTorch☆90Updated 3 years ago
- A convolution-free, transformer-only version of the CycleGAN framework☆33Updated 3 years ago
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆119Updated last year
- Load any clip model with a standardized interface☆21Updated last week
- A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…☆47Updated 2 years ago
- Local Attention - Flax module for Jax☆22Updated 4 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 3 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆217Updated 2 years ago
- Little article showing how to load pytorch's models with linear memory consumption☆34Updated 3 years ago
- Contrastive Language-Image Pretraining☆38Updated last year
- Another attempt at a long-context / efficient transformer by me☆38Updated 3 years ago
- Simple python template☆42Updated last year
- Framework for writing deep learning training loops. Lightweight, and retaining full freedom to design as you see fits. It handles checkpo…☆116Updated last year
- Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"☆59Updated 2 years ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆80Updated 3 years ago