AILab-CVC / GPT4Tools
GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the user to interact with images during a conversation.
☆772Updated last year
Alternatives and similar repositories for GPT4Tools:
Users that are interested in GPT4Tools are comparing it to the libraries listed below
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆785Updated last year
- Official repo for MM-REACT☆949Updated last year
- [CVPR 2025] Video Narration as Vocabulary & Video as Long Document☆569Updated last month
- ☆773Updated 9 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆739Updated last year
- Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".☆1,129Updated last year
- Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.☆273Updated last year
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆520Updated last year
- ☆1,029Updated last year
- ☆904Updated last year
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆863Updated 4 months ago
- LOMO: LOw-Memory Optimization☆985Updated 10 months ago
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆508Updated last year
- Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".☆658Updated 7 months ago
- MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.☆929Updated last month
- Multimodal-GPT☆1,498Updated last year
- Code for fine-tuning Platypus fam LLMs using LoRA☆629Updated last year
- Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".☆792Updated last year
- AgentTuning: Enabling Generalized Agent Abilities for LLMs☆1,432Updated last year
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆633Updated 9 months ago
- Official Repository of ChatCaptioner☆464Updated 2 years ago
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆547Updated last year
- Research Trends in LLM-guided Multimodal Learning.☆358Updated last year
- ☆778Updated 10 months ago
- Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…☆519Updated last year
- An Open-source Toolkit for LLM Development☆2,776Updated 3 months ago
- An opensource ChatBot built with ExpertPrompting which achieves 96% of ChatGPT's capability.☆300Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆941Updated 6 months ago
- An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …☆360Updated last year
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆349Updated last year