AILab-CVC / GPT4Tools
GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the user to interact with images during a conversation.
☆768Updated last year
Alternatives and similar repositories for GPT4Tools:
Users that are interested in GPT4Tools are comparing it to the libraries listed below
- Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".☆1,122Updated last year
- Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".☆785Updated 11 months ago
- MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.☆921Updated this week
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆782Updated last year
- ☆1,028Updated last year
- ☆770Updated 7 months ago
- Official repo for MM-REACT☆944Updated last year
- Multimodal-GPT☆1,495Updated last year
- ☆903Updated last year
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆864Updated 3 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆733Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆922Updated 5 months ago
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆542Updated last year
- [CVPR 2025] Video Narration as Vocabulary & Video as Long Document☆562Updated last week
- Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.☆271Updated last year
- LOMO: LOw-Memory Optimization☆979Updated 8 months ago
- [NIPS2023] RRHF & Wombat☆804Updated last year
- LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions☆820Updated last year
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆518Updated last year
- OpenAGI: When LLM Meets Domain Experts☆2,094Updated 3 months ago
- AgentTuning: Enabling Generalized Agent Abilities for LLMs☆1,402Updated last year
- Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".☆644Updated 6 months ago
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆508Updated last year
- Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…☆506Updated 11 months ago
- ☆772Updated 8 months ago
- An Open-source Toolkit for LLM Development☆2,763Updated 2 months ago
- Code for fine-tuning Platypus fam LLMs using LoRA☆628Updated last year
- [A toolbox for fun.] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.☆804Updated last year
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆619Updated 8 months ago
- An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …☆359Updated last year