TIGER-AI-Lab / Mantis

Related projects ⓘ

Alternatives and complementary repositories for Mantis

• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆246Updated 4 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆115Updated last week
• baaivision / EVE
  [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models
  ☆231Updated last month
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆102Updated 3 weeks ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆140Updated last month
• FudanNLPLAB / MouSi
  ☆73Updated 8 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆132Updated last month
• baaivision / CapsFusion
  [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale
  ☆194Updated 8 months ago
• thunlp / Muffin
  ☆58Updated 9 months ago
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆163Updated 5 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆75Updated last month
• X2FD / LVIS-INSTRUCT4V
  ☆131Updated 10 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆148Updated last month
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆235Updated 2 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆121Updated 3 weeks ago
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆255Updated 8 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆142Updated last week
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆131Updated this week
• luogen1996 / LLaVA-HR
  LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆212Updated 3 months ago
• THUDM / LVBench
  LVBench: An Extreme Long Video Understanding Benchmark
  ☆61Updated 2 months ago
• OpenGVLab / MMT-Bench
  ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆95Updated 4 months ago
• TideDra / VL-RLHF
  A RLHF Infrastructure for Vision-Language Models
  ☆104Updated this week
• TIGER-AI-Lab / VLM2Vec
  This repo contains the code and data for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks"
  ☆69Updated last week
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆267Updated 2 weeks ago
• vlf-silkie / VLFeedback
  ☆85Updated 10 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆179Updated last month
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆137Updated last week
• deepcs233 / Visual-CoT
  [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …
  ☆135Updated last month
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆134Updated 5 months ago
• tianyi-lab / HallusionBench
  [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…
  ☆246Updated last week