anguyen8 / vision-llms-are-blind

Related projects ⓘ

Alternatives and complementary repositories for vision-llms-are-blind

• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆62Updated 3 months ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆45Updated last month
• prometheus-eval / prometheus-vision
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…
  ☆58Updated 2 months ago
• apple / ml-rpm-bench
  ☆38Updated 4 months ago
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆88Updated 5 months ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆70Updated 2 months ago
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆38Updated 2 months ago
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆35Updated 10 months ago
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024 Highlight)
  ☆161Updated 2 months ago
• UCSC-VLAA / Recap-DataComp-1B
  This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆121Updated 5 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆84Updated this week
• vis-nlp / ChartGemma
  ☆55Updated 4 months ago
• XiaoduoAILab / XmodelVLM
  ☆61Updated 5 months ago
• togethercomputer / Dragonfly
  ☆68Updated last month
• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆169Updated 3 weeks ago
• CERC-AAI / Robin
  ☆62Updated 2 months ago
• Yushi-Hu / VisualSketchpad
  Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  ☆124Updated 3 weeks ago
• chenllliang / DnD-Transformer
  Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegrained Image …
  ☆55Updated last month
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆56Updated last month
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆19Updated this week
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆25Updated 4 months ago
• mistralai / mistral-evals
  ☆49Updated last month
• IntelLabs / multimodal_cognitive_ai
  research work on multimodal cognitive ai
  ☆56Updated 2 weeks ago
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆109Updated 7 months ago
• naver-ai / model-stock
  Model Stock: All we need is just a few fine-tuned models
  ☆92Updated 2 months ago
• aimagelab / LLaVA-MORE
  LLaVA-MORE: Enhancing Visual Instruction Tuning with LLaMA 3.1
  ☆86Updated last month
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆49Updated 3 months ago
• sehyunkwon / ICTC
  This is a public repository for Image Clustering Conditioned on Text Criteria (IC|TC)
  ☆80Updated 8 months ago
• stanfordmlgroup / ManyICL
  ☆128Updated 6 months ago
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆39Updated last month