AILab-CVC / GPT4Tools
GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the user to interact with images during a conversation.
☆770Updated last year
Alternatives and similar repositories for GPT4Tools:
Users that are interested in GPT4Tools are comparing it to the libraries listed below
- Official repo for MM-REACT☆946Updated last year
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆783Updated last year
- Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".☆1,124Updated last year
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆864Updated 3 months ago
- MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.☆923Updated 2 weeks ago
- ☆770Updated 7 months ago
- ☆1,027Updated last year
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆734Updated last year
- Multimodal-GPT☆1,495Updated last year
- ☆903Updated last year
- Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…☆508Updated 11 months ago
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆518Updated last year
- Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.☆271Updated last year
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆508Updated last year
- Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".☆787Updated last year
- LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions☆820Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆927Updated 5 months ago
- Code for fine-tuning Platypus fam LLMs using LoRA☆628Updated last year
- AgentTuning: Enabling Generalized Agent Abilities for LLMs☆1,411Updated last year
- LOMO: LOw-Memory Optimization☆982Updated 9 months ago
- [A toolbox for fun.] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.☆806Updated last year
- ☆773Updated 8 months ago
- An Open-source Toolkit for LLM Development☆2,765Updated 2 months ago
- Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".☆651Updated 6 months ago
- An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …☆359Updated last year
- Salesforce open-source LLMs with 8k sequence length.☆716Updated 2 months ago
- CodeGen2 models for program synthesis☆274Updated last year
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆347Updated last year
- [CVPR 2025] Video Narration as Vocabulary & Video as Long Document☆565Updated 3 weeks ago
- 🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".☆480Updated last year