Alternatives and similar repositories for video_rep_learning

Users that are interested in video_rep_learning are comparing it to the libraries listed below

• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆22Updated 2 years ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated 2 years ago
• allenai / grit_official
  Official repository for the General Robust Image Task (GRIT) Benchmark
  ☆54Updated 2 years ago
• facebookresearch / VLaMP
  Code for “Pretrained Language Models as Visual Planners for Human Assistance”
  ☆61Updated 2 years ago
• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆27Updated 3 weeks ago
• LAION-AI / General-GPT
  ☆65Updated 2 years ago
• ml-jku / semantic-image-text-alignment
  ☆25Updated 2 years ago
• top-yun / SPARK
  A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.
  ☆19Updated last year
• LAION-AI / laion50BU
  Un-*** 50 billions multimodality dataset
  ☆23Updated 3 years ago
• eric-ai-lab / Discffusion
  Official repo for the TMLR paper "Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learners"
  ☆30Updated last year
• google / video-localized-narratives
  ☆60Updated 2 years ago
• eric-ai-lab / ComCLIP
  Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
  ☆37Updated last year
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆40Updated last year
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆104Updated 2 years ago
• DCDmllm / HyperLLaVA
  Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models
  ☆28Updated last year
• allenai / signal-and-noise
  Measuring the Signal to Noise Ratio in Language Model Evaluation
  ☆28Updated 5 months ago
• kyegomez / HSSS
  Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…
  ☆15Updated last year
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated 2 years ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated 2 years ago
• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆55Updated 2 years ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 3 years ago
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated 2 years ago
• jeykigung / HiCLIP
  ☆30Updated 2 years ago
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆37Updated 2 years ago
• facebookresearch / EgoT2
  Code release for the paper "Egocentric Video Task Translation" (CVPR 2023 Highlight)
  ☆34Updated 2 years ago
• facebookresearch / HierVL
  [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
  ☆46Updated 2 years ago
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆22Updated 2 years ago
• jialuli-luka / SELMA
  Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data
  ☆35Updated last year
• kyegomez / PaLM2-VAdapter
  Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…
  ☆17Updated last year
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated last year