LAION-AI / temporal-embedding-aggregation
Aggregating embeddings over time
☆31Updated 2 years ago
Alternatives and similar repositories for temporal-embedding-aggregation:
Users that are interested in temporal-embedding-aggregation are comparing it to the libraries listed below
- multimodal video-audio-text generation and retrieval between every pair of modalities on the MUGEN dataset. The repo. contains the traini…☆39Updated last year
- Un-*** 50 billions multimodality dataset☆24Updated 2 years ago
- JAX implementation ViT-VQGAN☆80Updated 2 years ago
- VideoCC is a dataset containing (video-URL, caption) pairs for training video-text machine learning models. It is created using an automa…☆76Updated 2 years ago
- Script and models for clustering LAION-400m CLIP embeddings.☆25Updated 3 years ago
- Contrastive Language-Audio Pretraining☆15Updated 3 years ago
- PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)☆33Updated 2 years ago
- Command-line tool for downloading and extending the RedCaps dataset.☆46Updated last year
- Implementation of Retrieval-Augmented Denoising Diffusion Probabilistic Models in Pytorch☆64Updated 2 years ago
- codebase for the SIMAT dataset and evaluation☆38Updated 3 years ago
- Load any clip model with a standardized interface☆21Updated 9 months ago
- Using pretrained encoder and language models to generate captions from multimedia inputs.☆94Updated last year
- ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.☆56Updated 3 years ago
- A non-JIT version implementation / replication of CLIP of OpenAI in pytorch☆34Updated 4 years ago
- CLOOB training (JAX) and inference (JAX and PyTorch)☆70Updated 2 years ago
- Simple python template☆40Updated 9 months ago
- An open source implementation of CLIP.☆32Updated 2 years ago
- Official Code of ICCV 2021 Paper: Learning to Cut by Watching Movies☆51Updated 2 years ago
- An implementation of simple diffusion in PyTorch (and JAX)☆35Updated 2 years ago
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- Let's make a video clip☆93Updated 2 years ago
- Inverts CLIP text embeds to image embeds and visualizes with deep-image-prior.☆35Updated 2 years ago
- ☆64Updated last year
- Guide diffusion on ImageBind embedding similarity☆28Updated last year
- Simple script to compute CLIP-based scores given a DALL-e trained model.☆30Updated 3 years ago
- ☆31Updated 3 years ago
- ☆28Updated 3 years ago
- Implementation of the video diffusion model and training scheme presented in the paper, Flexible Diffusion Modeling of Long Videos, in Py…☆84Updated 2 years ago
- Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch☆59Updated 4 years ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆111Updated 2 years ago