kyegomez / AnyMAL
The open source implementation of "AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model"
☆22Updated this week
Alternatives and similar repositories for AnyMAL:
Users that are interested in AnyMAL are comparing it to the libraries listed below
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆28Updated 3 months ago
- ☆66Updated last year
- On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆36Updated 2 months ago
- ☆29Updated last week
- 🎮Manipulates mobile phones just like how you would. Official code for "MobA: A Two-Level Agent System for Efficient Mobile Task Automati…☆16Updated 2 months ago
- [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model☆17Updated 9 months ago
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated 10 months ago
- survery of small language models☆14Updated 5 months ago
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆29Updated 9 months ago
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆31Updated 6 months ago
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆101Updated 10 months ago
- Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!☆40Updated last year
- Touchstone: Evaluating Vision-Language Models by Language Models☆80Updated last year
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆40Updated 9 months ago
- Empirical Study Towards Building An Effective Multi-Modal Large Language Model☆23Updated last year
- ☆15Updated 2 weeks ago
- ControlLLM: Augment Language Models with Tools by Searching on Graphs☆188Updated 6 months ago
- ☆24Updated last year
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆40Updated 6 months ago
- FuseAI Project☆75Updated last month
- ☆34Updated 3 months ago
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆15Updated 2 months ago
- Code for NeurIPS 2024 paper "AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning"☆28Updated 2 months ago
- ☆28Updated last month
- An open-source implementaion for fine-tuning Molmo-7B-D and Molmo-7B-O by allenai.☆42Updated last week
- ☆49Updated 2 weeks ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆79Updated last month
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆77Updated last week
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆35Updated 7 months ago