Alternatives and similar repositories for MultitaskVLFM

Users that are interested in MultitaskVLFM are comparing it to the libraries listed below

• htqin / GoogleBard-VisUnderstand
  How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges
  ☆30Updated 2 years ago
• umd-huang-lab / perceptionCLIP
  Code for our ICLR 2024 paper "PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts"
  ☆79Updated last year
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated 2 years ago
• sunsmarterjie / ChatterBox
  [AAAI2025] ChatterBox: Multi-round Multimodal Referring and Grounding, Multimodal, Multi-round dialogues
  ☆60Updated 9 months ago
• eric-ai-lab / ComCLIP
  Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
  ☆37Updated last year
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆79Updated 8 months ago
• AIFEG / BenchLMM
  [ECCV 2024] BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Models
  ☆86Updated last year
• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆27Updated 2 weeks ago
• TencentARC / ViSFT
  ☆36Updated 2 years ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆64Updated 6 months ago
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• codezakh / LilT
  [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning
  ☆40Updated 2 years ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆42Updated last month
• DCDmllm / MorphTokens
  ☆43Updated last year
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated 2 years ago
• wjpoom / SPEC
  [CVPR 2024] The official implementation of paper "synthesize, diagnose, and optimize: towards fine-grained vision-language understanding"
  ☆50Updated 7 months ago
• lambert-x / ProLab
  Official Pytorch Implementation of Paper "A Semantic Space is Worth 256 Language Descriptions: Make Stronger Segmentation Models with Des…
  ☆55Updated 5 months ago
• iancovert / locality-alignment
  ☆54Updated last year
• OpenGVLab / Multitask-Model-Selector
  [NIPS2023]Implementation of Foundation Model is Efficient Multimodal Multitask Model Selector
  ☆37Updated last year
• OliverRensu / D-iGPT
  [ICML 2024] This repository includes the official implementation of our paper "Rejuvenating image-GPT as Strong Visual Representation Lea…
  ☆98Updated last year
• facebookresearch / genecis
  Code and Models for "GeneCIS A Benchmark for General Conditional Image Similarity"
  ☆61Updated 2 years ago
• Shengcao-Cao / groundLMM
  Emergent Visual Grounding in Large Multimodal Models Without Grounding Supervision
  ☆42Updated 3 months ago
• jihaonew / MM-Instruct
  MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment
  ☆35Updated last year
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• Hritikbansal / videocon
  ☆58Updated last year
• m1k2zoo / negbench
  Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"
  ☆44Updated 9 months ago
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆35Updated last year
• MCR-PEFT / Ex-MCR
  ☆45Updated 8 months ago
• opendatalab / CLIP-Parrot-Bias
  ECCV2024_Parrot Captions Teach CLIP to Spot Text
  ☆66Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago