Alternatives and similar repositories for multimodal_cognitive_ai

Users that are interested in multimodal_cognitive_ai are comparing it to the libraries listed below

• DCDmllm / HyperLLaVA
  Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models
  ☆28Updated last year
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆36Updated last year
• salesforce / GlueGen
  ☆63Updated last week
• hila-chefer / Conceptor
  Official implementation of the paper The Hidden Language of Diffusion Models
  ☆73Updated last year
• jialuli-luka / SELMA
  Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data
  ☆34Updated last year
• UCSC-VLAA / Recap-DataComp-1B
  [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆134Updated last year
• idansc / discriminative_class_tokens
  ☆40Updated last year
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆51Updated 10 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆29Updated 7 months ago
• WeihuangLin / INF-LLaVA
  INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
  ☆42Updated 10 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆44Updated 3 months ago
• pinterest / atg-research
  ☆63Updated 3 weeks ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆77Updated 3 weeks ago
• RE-N-Y / imscore
  Minimal Differentiable Image Reward Functions
  ☆60Updated 2 months ago
• InfiMM / mllm-hd
  Official code for infimm-hd
  ☆16Updated 9 months ago
• google / storybench
  ☆50Updated last year
• huggingface / movie-shot-categorizer
  Fine-tune of Florence-2 for shot categorization.
  ☆24Updated 3 months ago
• RE-N-Y / sae
  ☆17Updated 7 months ago
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆27Updated 6 months ago
• locuslab / diffusion-model-hallucination
  ☆42Updated 9 months ago
• katiekang1998 / reasoning_generalization
  ☆32Updated 5 months ago
• cyzus / thoughtsculpt
  ☆13Updated 6 months ago
• zer0int / CLIP-SAE-finetune
  Sparse Autoencoders (SAE) vs CLIP fine-tuning fun.
  ☆15Updated 6 months ago
• AnonymousAlethiometer / SGD_SaI
  Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"
  ☆52Updated 4 months ago
• McGill-NLP / AURORA
  Code and data for the paper: Learning Action and Reasoning-Centric Image Editing from Videos and Simulation
  ☆28Updated 5 months ago
• mapo-t2i / mapo
  Official codebase for Margin-aware Preference Optimization for Aligning Diffusion Models without Reference (MaPO).
  ☆78Updated last year
• cloneofsimo / repa-rf
  ☆33Updated 7 months ago
• theAdamColton / vq-clip
  Train vector quantized CLIP models using pytorch lightning
  ☆20Updated 11 months ago
• kyegomez / KosmosG
  My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"
  ☆15Updated 7 months ago
• eric-ai-lab / ComCLIP
  Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
  ☆35Updated 10 months ago