DCDmllm / Cheetah

Related projects: ⓘ

• zhuyiche / llava-phi
  ☆356Updated 4 months ago
• xiaoachen98 / Open-LLaVA-NeXT
  An open-source implementation for training LLaVA-NeXT.
  ☆243Updated 3 months ago
• ZrrSkywalker / MathVerse
  [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
  ☆133Updated 2 weeks ago
• NVlabs / EAGLE
  EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders
  ☆404Updated this week
• FoundationVision / Groma
  [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
  ☆537Updated 3 months ago
• meta-math / MetaMath
  MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
  ☆372Updated 7 months ago
• mlpc-ucsd / BLIVA
  (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
  ☆260Updated 5 months ago
• OpenGVLab / CaFo
  [CVPR 2023] Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners
  ☆343Updated last year
• UniModal4Reasoning / ChartVLM
  Official Repository of ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning
  ☆208Updated last week
• uclaml / SPPO
  The official implementation of Self-Play Preference Optimization (SPPO)
  ☆461Updated last month
• RLHFlow / Online-RLHF
  A recipe for online RLHF.
  ☆376Updated 3 weeks ago
• linzhiqiu / t2v_metrics
  Evaluating text-to-image/video/3D models with VQAScore
  ☆169Updated last week
• EvolvingLMMs-Lab / lmms-eval
  Accelerating the development of large multimodal models (LMMs) with lmms-eval
  ☆1,349Updated this week
• llava-rlhf / LLaVA-RLHF
  Aligning LMMs with Factually Augmented RLHF
  ☆302Updated 10 months ago
• RLHFlow / RLHF-Reward-Modeling
  Recipes to train reward model for RLHF.
  ☆634Updated last week
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆345Updated 9 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆252Updated 3 weeks ago
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆252Updated 3 months ago
• DCDmllm / WorldGPT
  WorldGPT: Empowering LLM as Multimodal World Model
  ☆116Updated last month
• ZrrSkywalker / MAVIS
  Mathematical Visual Instruction Tuning for Multi-modal Large Language Models
  ☆86Updated last month
• dongyh20 / Chain-of-Spot
  Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models
  ☆81Updated 5 months ago
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆347Updated 11 months ago
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆275Updated 2 months ago
• thunlp / LLaVA-UHD
  LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images
  ☆298Updated last month
• ShihaoZhaoZSH / LaVi-Bridge
  [ECCV 2024] Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation
  ☆302Updated 2 months ago
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆184Updated 2 months ago
• FoundationVision / OmniTokenizer
  OmniTokenizer: one model and one weight for image-video joint tokenization.
  ☆228Updated 2 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆138Updated last week
• kohjingyu / gill
  🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".
  ☆417Updated 8 months ago
• allenai / unified-io-2
  ☆557Updated 7 months ago