Alternatives and similar repositories for VisOnlyQA

Users that are interested in VisOnlyQA are comparing it to the libraries listed below

• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆28Updated 11 months ago
• allenai / sso
  Repository for Skill Set Optimization
  ☆13Updated 10 months ago
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• bigai-nlco / LatentSeek
  Official Repository of LatentSeek
  ☆48Updated 2 weeks ago
• yale-nlp / refdpo
  ☆16Updated 11 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆50Updated 2 weeks ago
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆30Updated 3 weeks ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆57Updated 8 months ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated last year
• dvlab-research / ARPO
  Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay
  ☆78Updated 3 weeks ago
• test-time-interaction / TTI
  ☆36Updated 2 weeks ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆46Updated 7 months ago
• DualityRL / multi-attempt
  ☆18Updated 3 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• facebookresearch / multimodal_rewardbench
  Multimodal RewardBench
  ☆41Updated 4 months ago
• dqxiu / KAssess
  ☆14Updated last year
• GAIR-NLP / benbench
  Benchmarking Benchmark Leakage in Large Language Models
  ☆52Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆19Updated last year
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• DynaMath / DynaMath
  A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models
  ☆24Updated 6 months ago
• khuangaf / CHOCOLATE
  Code and data for the ACL 2024 Findings paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"
  ☆26Updated last year
• MikeWangWZHL / Zemi
  Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings
  ☆16Updated 2 years ago
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆80Updated last year
• RenzeLou / AAAR-1.0
  The source code for running LLMs on the AAAR-1.0 benchmark.
  ☆16Updated 2 months ago
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆27Updated last month
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆45Updated 3 months ago
• umd-huang-lab / Mementos
  ☆31Updated last year
• yikangshen / megablocks
  ☆20Updated last year
• kaistAI / Volcano
  [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…
  ☆46Updated 10 months ago
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆25Updated last month