Ucas-HaoranWei / Vary
[ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.
☆1,818Updated 2 months ago
Alternatives and similar repositories for Vary:
Users that are interested in Vary are comparing it to the libraries listed below
- Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)☆617Updated 2 months ago
- 【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models☆1,730Updated this week
- [ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列☆1,053Updated 9 months ago
- GPT4V-level open-source multi-modal model based on Llama3-8B☆2,315Updated 3 weeks ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,788Updated 2 months ago
- A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team…☆1,665Updated 2 months ago
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Family☆2,438Updated 2 months ago
- [CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"☆804Updated 3 weeks ago
- An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)☆4,407Updated this week
- A family of lightweight multimodal models.☆1,006Updated 4 months ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆864Updated 3 months ago
- 百亿参数的中英文双语基座大模型☆2,436Updated last year
- On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)☆571Updated last month
- The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.☆440Updated 5 months ago
- ☆772Updated 8 months ago
- The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.☆5,670Updated 7 months ago
- Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sour…☆1,282Updated 2 weeks ago
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆508Updated last year
- 支持中英文双语视觉-文本对话的开源可商用多模态模型。☆368Updated last year
- 🩹Editing large language models within 10 seconds⚡☆1,317Updated last year
- Netease Youdao's open-source embedding and reranker models for RAG products.☆1,678Updated last month
- TigerBot: A multi-language multi-task LLM☆2,257Updated 2 months ago
- Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)☆2,652Updated 7 months ago
- A generalized information-seeking agent system with Large Language Models (LLMs).☆1,138Updated 9 months ago
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆4,994Updated this week
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)☆783Updated 7 months ago
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,560Updated 2 months ago
- [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"☆219Updated last month
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆425Updated last week
- ☆903Updated last year