THUDM / CogCoM

Related projects: ⓘ

• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆293Updated 3 weeks ago
• baaivision / EVE
  EVE: Encoder-Free Vision-Language Models
  ☆206Updated last month
• luogen1996 / LLaVA-HR
  LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆202Updated last month
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆138Updated last week
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆237Updated 2 months ago
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆218Updated last week
• pkunlp-icler / FastV
  [ECCV 2024] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Mo…
  ☆207Updated last month
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆189Updated 5 months ago
• OpenGVLab / OmniCorpus
  OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆246Updated 3 weeks ago
• thunlp / LLaVA-UHD
  LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images
  ☆298Updated last month
• zjysteven / lmms-finetune
  A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, qwen-vl, phi3-v …
  ☆123Updated this week
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆128Updated last month
• IVGSZ / Flash-VStream
  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"
  ☆105Updated last month
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning"
  ☆157Updated last week
• X2FD / LVIS-INSTRUCT4V
  ☆128Updated 8 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆80Updated 2 weeks ago
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆273Updated 2 months ago
• RLHF-V / RLAIF-V
  RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness
  ☆200Updated last week
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆252Updated 3 weeks ago
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆183Updated 2 months ago
• PhoenixZ810 / MG-LLaVA
  Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).
  ☆136Updated last month
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆378Updated 5 months ago
• HaozheZhao / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆321Updated 9 months ago
• FudanNLPLAB / MouSi
  ☆70Updated 6 months ago
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆114Updated 2 months ago
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆155Updated 3 weeks ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆303Updated 2 months ago
• SHI-Labs / VCoder
  VCoder: Versatile Vision Encoders for Multimodal Large Language Models, arXiv 2023 / CVPR 2024
  ☆255Updated 5 months ago
• MaverickRen / PixelLM
  PixelLM is an effective and efficient LMM for pixel-level reasoning and understanding. PixelLM is accepted by CVPR 2024.
  ☆174Updated 3 months ago
• SkyworkAI / Vitron
  A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing
  ☆282Updated 2 months ago