m&ms: A Benchmark to Evaluate Tool-Use for multi-step multi-modal tasks
☆47Sep 26, 2024Updated 2 years ago
Alternatives and similar repositories for mnms
Users that are interested in mnms are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.☆71Nov 27, 2024Updated last year
- ☆70Jun 2, 2026Updated 5 months ago
- Code for the paper "Neural Concept Map Generation for Effective Document Classification with Interpretable Structured Summarization" SIGI…☆20Jan 10, 2021Updated 5 years ago
- Code for the ICLR'24 paper: "Visual Data-Type Understanding does not emerge from Scaling Vision-Language Models"☆13Jan 17, 2024Updated 2 years ago
- [NeurIPS 2023] A faithful benchmark for vision-language compositionality☆98Feb 13, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆41Aug 25, 2025Updated last year
- [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios☆71Aug 5, 2025Updated last year
- ☆36Feb 5, 2024Updated 2 years ago
- UETT4K-Anti-UAV Dataset of drone images in 4K resolution contains 33601 images by Mughees Sarwar Awan PhD work☆13Apr 11, 2026Updated 7 months ago
- [ACL 2026] ExpSeek: Self-Triggered Experience Seeking for Web Agents☆11Jun 30, 2026Updated 4 months ago
- (ICLR 2025 Spotlight) Official code repository for Interleaved Scene Graph.☆31Aug 7, 2025Updated last year
- Web-grounded natural language instructions☆18Nov 25, 2024Updated last year
- Track and Collaborate on ML & AI Experiments.☆43Mar 10, 2025Updated last year
- Using conversational games to evaluate powerful LLMs☆18Sep 3, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆17Apr 10, 2025Updated last year
- ☆29Apr 30, 2024Updated 2 years ago
- 🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning☆16Jun 2, 2026Updated 5 months ago
- This is the official implementation for the ToolTree for ICLR_2026☆19Jul 5, 2026Updated 4 months ago
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆33Jul 21, 2025Updated last year
- 完全依靠ChatGPT生成数据微调的西式翻译腔聊天风格中文大模型☆21Apr 1, 2024Updated 2 years ago
- A high-performance mqtt server(broker) implemented using C++20 asio coroutine☆18Jun 27, 2025Updated last year
- ☆62Sep 26, 2025Updated last year
- [NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark☆230Feb 13, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Supercharge huggingface transformers with model parallelism.☆77Jul 23, 2025Updated last year
- Scene Graph Prediction with Limited Labels☆54Oct 3, 2023Updated 3 years ago
- Repo of "Large Language Model-based Human-Agent Collaboration for Complex Task Solving(EMNLP2024 Findings)"☆34Sep 20, 2024Updated 2 years ago
- ☆15Jan 7, 2026Updated 10 months ago
- [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning☆40Jul 29, 2023Updated 3 years ago
- MAT: Multi-modal Agent Tuning 🔥 ICLR 2025 (Spotlight)☆97Dec 18, 2025Updated 11 months ago
- ☆23Sep 2, 2025Updated last year
- Evaluating tool-augmented LLMs in conversation settings☆89May 31, 2024Updated 2 years ago
- We introduce Multi-P2A, a Multi-perspective Privacy Assessment aimed at evaluating privacy risks of LVLMs comprehensively.☆13Sep 23, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆26Updated this week
- [ICML 2026 Oral] Official Implementation for From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Ac…☆12Jul 5, 2026Updated 4 months ago
- PyTorch code for Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles (DANCE)☆22Nov 29, 2022Updated 3 years ago
- ☆12Aug 8, 2024Updated 2 years ago
- Regularly Truncated M-estimators for Learning with Noisy Labels☆11Apr 24, 2024Updated 2 years ago
- Official implementation of our paper "Benchmarking Language Model Creativity: A Case Study on Code Generation"☆14May 16, 2025Updated last year
- NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models☆10Oct 27, 2023Updated 3 years ago
Are these results useful?