Alternatives and similar repositories for multimodal_cognitive_ai

Users that are interested in multimodal_cognitive_ai are comparing it to the libraries listed below

• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆36Updated last year
• DCDmllm / HyperLLaVA
  Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models
  ☆28Updated last year
• salesforce / GlueGen
  ☆63Updated 4 months ago
• hila-chefer / Conceptor
  Official implementation of the paper The Hidden Language of Diffusion Models
  ☆72Updated last year
• McGill-NLP / AURORA
  Code and data for the paper: Learning Action and Reasoning-Centric Image Editing from Videos and Simulation
  ☆28Updated 4 months ago
• huggingface / movie-shot-categorizer
  Fine-tune of Florence-2 for shot categorization.
  ☆24Updated 2 months ago
• Picsart-AI-Research / Social-Reward
  ☆10Updated last year
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆33Updated last year
• InfiMM / mllm-hd
  Official code for infimm-hd
  ☆16Updated 9 months ago
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆51Updated 9 months ago
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated last year
• jialuli-luka / SELMA
  Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data
  ☆34Updated last year
• idansc / discriminative_class_tokens
  ☆41Updated last year
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆25Updated 5 months ago
• JinjieNi / MixEval-X
  The official github repo for MixEval-X, the first any-to-any, real-world benchmark.
  ☆14Updated 3 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆43Updated 3 months ago
• WeihuangLin / INF-LLaVA
  INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
  ☆42Updated 10 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 9 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆25Updated last month
• measure-infinity / mulan-code
  ☆40Updated 10 months ago
• pinterest / atg-research
  ☆63Updated this week
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆44Updated last month
• Adamdad / neumeta
  NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when n…
  ☆42Updated 6 months ago
• ml-jku / semantic-image-text-alignment
  ☆24Updated last year
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆75Updated 5 months ago
• huggingface / amused
  ☆85Updated last year
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆35Updated 11 months ago
• RE-N-Y / imscore
  Minimal Differentiable Image Reward Functions
  ☆56Updated last month
• TIGER-AI-Lab / VIEScore
  Visual Instruction-guided Explainable Metric. Code for "Towards Explainable Metrics for Conditional Image Synthesis Evaluation" (ACL 2024…
  ☆44Updated 6 months ago
• htqin / GoogleBard-VisUnderstand
  How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges
  ☆30Updated last year