JinjieNi / MixEval-XLinks
The official github repo for MixEval-X, the first any-to-any, real-world benchmark.
☆15Updated 8 months ago
Alternatives and similar repositories for MixEval-X
Users that are interested in MixEval-X are comparing it to the libraries listed below
Sorting:
- [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents☆46Updated 7 months ago
- Official code and dataset for our EMNLP 2024 Findings paper: Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Kn…☆18Updated 9 months ago
- ☆50Updated 4 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆67Updated 6 months ago
- Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data☆35Updated last year
- This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"☆16Updated 2 months ago
- This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs☆31Updated 7 months ago
- Official implementation of ECCV24 paper: POA☆24Updated last year
- [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…☆77Updated 10 months ago
- YesBut - Multimodal Satire Comprehension Dataset☆18Updated 11 months ago
- This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.☆18Updated last year
- VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)☆44Updated last year
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆27Updated last year
- ☆16Updated last year
- An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"☆52Updated 2 years ago
- Resa: Transparent Reasoning Models via SAEs☆43Updated 3 weeks ago
- Interface for GenAI-Arena☆14Updated last year
- 😊 TPTT: Transforming Pretrained Transformers into Titans☆29Updated 3 weeks ago
- CODA: Coordinating the Cerebrum and Cerebellum for a Dual-Brain Computer Use Agent with Decoupled Reinforcement Learning☆32Updated last month
- Quick Long Video Understanding☆65Updated 4 months ago
- Official implementation of the paper The Hidden Language of Diffusion Models☆74Updated last year
- PyTorch implementation of StableMask (ICML'24)☆14Updated last year
- A unified framework for controllable caption generation across images, videos, and audio. Supports multi-modal inputs and customizable ca…☆51Updated 2 months ago
- The official PyTorch implementation for Improving Long-Text Alignment for Text-to-Image Diffusion Models (LongAlign)☆81Updated 5 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆43Updated last year
- official code for "BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning"☆36Updated 8 months ago
- [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models☆49Updated 5 months ago
- The official repo of continuous speculative decoding☆30Updated 6 months ago
- MIO: A Foundation Model on Multimodal Tokens☆30Updated 10 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆87Updated last year