AILab-CVC / GPT4Tools
GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the user to interact with images during a conversation.
☆763Updated last year
Alternatives and similar repositories for GPT4Tools:
Users that are interested in GPT4Tools are comparing it to the libraries listed below
- Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".☆1,103Updated last year
- Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".☆775Updated 9 months ago
- ☆762Updated 5 months ago
- ☆1,025Updated last year
- Official repo for MM-REACT☆940Updated 11 months ago
- ☆900Updated last year
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆777Updated last year
- Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.☆272Updated last year
- AgentTuning: Enabling Generalized Agent Abilities for LLMs☆1,383Updated last year
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆858Updated last month
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆720Updated 11 months ago
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆506Updated last year
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆513Updated 11 months ago
- ☆756Updated 6 months ago
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,518Updated 2 weeks ago
- MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.☆916Updated 7 months ago
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆338Updated last year
- GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest☆521Updated 7 months ago
- Multimodal-GPT☆1,488Updated last year
- Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".☆623Updated 3 months ago
- LOMO: LOw-Memory Optimization☆979Updated 6 months ago
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆223Updated last year
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆541Updated last year
- LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions☆815Updated last year
- Transform Video as a Document with ChatGPT, CLIP, BLIP2, GRIT, Whisper, LangChain.☆549Updated last year
- An opensource ChatBot built with ExpertPrompting which achieves 96% of ChatGPT's capability.☆296Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆902Updated 2 months ago
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,615Updated last year
- Research Trends in LLM-guided Multimodal Learning.☆356Updated last year
- A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)☆1,092Updated last year