AILab-CVC / GPT4Tools
GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the user to interact with images during a conversation.
☆770Updated last year
Alternatives and similar repositories for GPT4Tools:
Users that are interested in GPT4Tools are comparing it to the libraries listed below
- ☆1,027Updated last year
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆783Updated last year
- Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".☆1,124Updated last year
- Official repo for MM-REACT☆946Updated last year
- Multimodal-GPT☆1,495Updated last year
- ☆771Updated 7 months ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆864Updated 3 months ago
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆508Updated last year
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆734Updated last year
- Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".☆787Updated last year
- LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transform…☆1,450Updated last year
- Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.☆271Updated last year
- ☆903Updated last year
- LOMO: LOw-Memory Optimization☆982Updated 8 months ago
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆518Updated last year
- AgentTuning: Enabling Generalized Agent Abilities for LLMs☆1,405Updated last year
- Dromedary: towards helpful, ethical and reliable LLMs.☆1,141Updated last year
- [CVPR 2025] Video Narration as Vocabulary & Video as Long Document☆565Updated 2 weeks ago
- [A toolbox for fun.] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.☆805Updated last year
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,560Updated 3 months ago
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆542Updated last year
- Code for fine-tuning Platypus fam LLMs using LoRA☆628Updated last year
- MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.☆923Updated last week
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆226Updated last year
- ☆1,694Updated 6 months ago
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆622Updated 8 months ago
- Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".☆649Updated 6 months ago
- Salesforce open-source LLMs with 8k sequence length.☆716Updated 2 months ago
- Official Repository of ChatCaptioner☆463Updated last year
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆801Updated 9 months ago