kyegomez / AnyMAL
The open source implementation of "AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model"
☆21Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for AnyMAL
- Empirical Study Towards Building An Effective Multi-Modal Large Language Model☆23Updated last year
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆26Updated 2 months ago
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated 8 months ago
- [NeurIPS 2024] TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration☆17Updated last month
- ☆65Updated last year
- ☆19Updated 11 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆38Updated 4 months ago
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆38Updated 7 months ago
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆31Updated 4 months ago
- ☆25Updated this week
- [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model☆16Updated 7 months ago
- ☆45Updated last year
- Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges☆49Updated 2 months ago
- 🎮Manipulates mobile phones just like how you would. Official code for "MobA: A Two-Level Agent System for Efficient Mobile Task Automati…☆13Updated 3 weeks ago
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆38Updated 8 months ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆32Updated 5 months ago
- survery of small language models☆12Updated 4 months ago
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆99Updated 8 months ago
- My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"☆14Updated 2 weeks ago
- A light-weight and high-efficient training framework for accelerating diffusion tasks.☆41Updated 2 months ago
- ☆10Updated 5 months ago
- INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model☆39Updated 3 months ago
- FuseAI Project☆76Updated 3 months ago
- VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation☆84Updated 2 months ago
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Updated last month
- Vision-oriented multimodal AI☆49Updated 5 months ago
- ControlLLM: Augment Language Models with Tools by Searching on Graphs☆186Updated 4 months ago
- ☆23Updated 4 months ago
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆29Updated 7 months ago