Alternatives and similar repositories for MixEval-X:

Users that are interested in MixEval-X are comparing it to the libraries listed below

• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆41Updated this week
• jdf-prog / LLM-Engines
  ☆41Updated 3 weeks ago
• leezythu / FocusLLM
  FocusLLM: Scaling LLM’s Context by Parallel Decoding
  ☆34Updated last month
• apple / ml-mia-bench
  ☆23Updated 2 months ago
• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆31Updated 2 months ago
• HanSolo9682 / CounterCurate
  This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.
  ☆17Updated 7 months ago
• McGill-NLP / AURORA
  Code and data for the paper: Learning Action and Reasoning-Centric Image Editing from Videos and Simulation
  ☆22Updated 2 weeks ago
• jialuli-luka / SELMA
  Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data
  ☆33Updated 10 months ago
• chenllliang / DnD-Transformer
  Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegrained Image …
  ☆63Updated last month
• SprocketLab / sparse_matrix_fine_tuning
  Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"
  ☆17Updated 3 weeks ago
• TIGER-AI-Lab / VISTA
  This repo contains code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation"
  ☆11Updated 3 weeks ago
• yale-nlp / refdpo
  ☆15Updated 6 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 5 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆35Updated 2 months ago
• alif-munim / minOFT
  A minimal re-implementation of orthogonal fine-tuning (OFT) for LLMs. Based on nanoGPT and minLoRA.
  ☆12Updated last year
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆44Updated last month
• eric-ai-lab / Screen-Point-and-Read
  Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"
  ☆24Updated 5 months ago
• princeton-nlp / ELIZA-Transformer
  Representing Rule-based Chatbots with Transformers
  ☆19Updated 6 months ago
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆22Updated 3 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆26Updated 6 months ago
• hila-chefer / Conceptor
  Official implementation of the paper The Hidden Language of Diffusion Models
  ☆69Updated last year
• Infini-AI-Lab / S2FT
  ☆12Updated 3 weeks ago
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]
  ☆54Updated this week
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆41Updated 2 months ago
• kyegomez / KosmosG
  My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"
  ☆14Updated 2 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆76Updated 4 months ago
• umd-huang-lab / Mementos
  ☆28Updated 11 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆48Updated 3 months ago
• lucasjinreal / ImageTokenizer
  imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…
  ☆30Updated 7 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 7 months ago