IntelLabs / GraVi-T

Related projects: ⓘ

• Jyxarthur / AutoAD-Zero
  Official Implementation of "AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description". Junyu Xie, Tengda Han, Max Bain, Ars…
  ☆15Updated last month
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆45Updated 4 months ago
• oncescuandreea / QuerYD_downloader
  ☆20Updated 9 months ago
• TengdaHan / AutoAD
  [CVPR'23 Highlight] AutoAD: Movie Description in Context.
  ☆85Updated last month
• SRA2 / SPELL
  Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection (ECCV 2022)
  ☆64Updated 10 months ago
• bpiyush / TestOfTime
  Official code for our CVPR 2023 paper: Test of Time: Instilling Video-Language Models with a Sense of Time
  ☆45Updated 3 months ago
• sangho-vision / avbert
  ☆31Updated 3 years ago
• KastanDay / video-pretrained-transformer
  Multi-model video-to-text by combining embeddings from Flan-T5 + CLIP + Whisper + SceneGraph. The 'backbone LLM' is pre-trained from scra…
  ☆49Updated last year
• GenjiB / ECLIPSE
  ☆30Updated last year
• MCR-PEFT / Ex-MCR
  ☆35Updated 11 months ago
• SMILE-data / SMILE
  SMILE: A Multimodal Dataset for Understanding Laughter
  ☆13Updated last year
• visipedia / ssw60
  Sapsucker Woods 60 Audiovisual Dataset
  ☆14Updated last year
• PardoAlejo / MovieCuts
  Learning to cut end-to-end pretrained modules
  ☆26Updated 2 months ago
• google-research-datasets / videoCC-data
  VideoCC is a dataset containing (video-URL, caption) pairs for training video-text machine learning models. It is created using an automa…
  ☆76Updated last year
• ByZ0e / Glance-Focus
  This repo contains source code for Glance and Focus: Memory Prompting for Multi-Event Video Question Answering (Accepted in NeurIPS 2023)
  ☆19Updated 2 months ago
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆97Updated 11 months ago
• TXH-mercury / COSA
  Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
  ☆38Updated last year
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆24Updated last week
• facebookresearch / EgoT2
  Code release for the paper "Egocentric Video Task Translation" (CVPR 2023 Highlight)
  ☆31Updated last year
• sangho-vision / acav100m
  ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.
  ☆55Updated 2 years ago
• google / storybench
  ☆47Updated 11 months ago
• DmitryRyumin / FG-2024-Papers
  FG 2024 Papers: Explore a comprehensive collection of research papers presented at one of the premier conferences on automatic face and g…
  ☆10Updated 4 months ago
• Shahzadnit / EZ-CLIP
  ☆17Updated 5 months ago
• salesforce / GlueGen
  ☆58Updated 10 months ago
• SJTUwxz / LoCoNet_ASD
  code repo for LoCoNet: Long-Short Context Network for Active Speaker Detection
  ☆16Updated last year
• dominickrei / pi-vit
  [CVPR 2024] Code and models for pi-ViT, a video transformer for understanding activities of daily living
  ☆11Updated 3 weeks ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated last month
• Hritikbansal / videocon
  ☆52Updated 4 months ago
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆35Updated 3 weeks ago