amazon-science / QA-ViT

Related projects: ⓘ

• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆93Updated last week
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆100Updated 2 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆67Updated 3 weeks ago
• UX-Decoder / FIND
  Official implementation of the paper "Interfacing Foundation Models' Embeddings"
  ☆107Updated 3 weeks ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆39Updated last week
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆61Updated 4 months ago
• kahnchana / mvu
  Multimodal Video Understanding Framework (MVU)
  ☆23Updated 4 months ago
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆75Updated 5 months ago
• HJYao00 / DenseConnector
  Dense Connector for MLLMs
  ☆98Updated last month
• isekai-portal / Link-Context-Learning
  ☆80Updated 4 months ago
• facebookresearch / HierVL
  [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
  ☆43Updated last year
• ChenDelong1999 / subobjects
  Official repository of paper "Subobject-level Image Tokenization"
  ☆58Updated 4 months ago
• mbzuai-oryx / CVRR-Evaluation-Suite
  Official repository of paper titled "How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMs".
  ☆39Updated 3 weeks ago
• umd-huang-lab / perceptionCLIP
  Code for our ICLR 2024 paper "PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts"
  ☆76Updated 4 months ago
• lezhang7 / Enhance-FineGrained
  [CVPR' 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding
  ☆35Updated last month
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆27Updated 3 months ago
• deepcs233 / Visual-CoT
  Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning
  ☆93Updated 2 months ago
• mrwu-mac / ControlMLLM
  Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆44Updated 3 weeks ago
• DCDmllm / MorphTokens
  ☆40Updated 4 months ago
• OliverRensu / D-iGPT
  [ICML 2024] This repository includes the official implementation of our paper "Rejuvenating image-GPT as Strong Visual Representation Lea…
  ☆96Updated 4 months ago
• TempleX98 / MoVA
  MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆116Updated last week
• CeeZh / LLoVi
  Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"
  ☆81Updated 5 months ago
• orrzohar / Video-STaR
  Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆44Updated 2 months ago
• yuhui-zh15 / C3
  Official implementation of "Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data" (ICLR 2024)
  ☆27Updated 3 months ago
• zyf0619sjtu / DreamLIP
  [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions
  ☆85Updated last week
• alibaba / conv-llava
  ☆100Updated last month
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆67Updated 5 months ago
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024)
  ☆153Updated last month
• chuangchuangtan / LLaVA-NeXT-Image-Llama3-Lora
  LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft
  ☆37Updated 2 months ago
• mlfoundations / VisIT-Bench
  ☆46Updated 10 months ago