kyegomez / AnyMALLinks
The open source implementation of "AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model"
☆21Updated 7 months ago
Alternatives and similar repositories for AnyMAL
Users that are interested in AnyMAL are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated last year
- Vision-oriented multimodal AI☆49Updated last year
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 11 months ago
- On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆40Updated last month
- ControlLLM: Augment Language Models with Tools by Searching on Graphs☆193Updated last year
- This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]☆74Updated 2 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆43Updated last year
- Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆90Updated 2 years ago
- Empirical Study Towards Building An Effective Multi-Modal Large Language Model☆22Updated last year
- 🎮Manipulates mobile phones just like how you would. Official code for "MobA: A Two-Level Agent System for Efficient Mobile Task Automati…☆25Updated 4 months ago
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆35Updated last year
- ☆48Updated 3 months ago
- ☆66Updated 2 years ago
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆104Updated last year
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆40Updated last year
- ☆74Updated last year
- Touchstone: Evaluating Vision-Language Models by Language Models☆83Updated last year
- High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning☆47Updated last month
- (ACL-2025 main conference) Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback☆27Updated 2 months ago
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆29Updated last year
- ☆34Updated 7 months ago
- Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding☆53Updated 8 months ago
- Official implementation of "PyVision: Agentic Vision with Dynamic Tooling."☆122Updated last month
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆47Updated last year
- [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents☆46Updated 6 months ago
- Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation☆142Updated 10 months ago
- Our 2nd-gen LMM☆34Updated last year
- survery of small language models☆16Updated last year
- OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024☆60Updated 6 months ago
- ☆19Updated 9 months ago