Alternatives and similar repositories for ControlLLM:

Users that are interested in ControlLLM are comparing it to the libraries listed below

• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆121Updated last month
• THUDM / CogCoM
  ☆168Updated 9 months ago
• microsoft / simulated-trial-and-error
  ☆121Updated 10 months ago
• showlab / assistgpt
  ☆65Updated last year
• HyperGAI / HPT
  HPT - Open Multimodal LLMs from HyperGAI
  ☆314Updated 10 months ago
• DAMO-NLP-SG / multimodal_textbook
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆149Updated 3 weeks ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]
  ☆210Updated 3 weeks ago
• YujieLu10 / LLMScore
  LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
  ☆128Updated last year
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆227Updated last year
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆179Updated 7 months ago
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆221Updated last year
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆239Updated 3 months ago
• anchen1011 / FireAct
  FireAct: Toward Language Agent Fine-tuning
  ☆275Updated last year
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆430Updated 4 months ago
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆266Updated 10 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆78Updated 5 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆294Updated 2 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated last week
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆276Updated 11 months ago
• gpt4video / GPT4Video
  Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation
  ☆138Updated 5 months ago
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆231Updated 8 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆99Updated last month
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆82Updated last year
• stanfordmlgroup / ManyICL
  ☆139Updated 10 months ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆114Updated 4 months ago
• Dongping-Chen / GUI-World
  (ICLR 2025) The Official Code Repository for GUI-World.
  ☆53Updated 3 months ago
• HaozheZhao / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆348Updated last year
• JiuTian-VL / Optimus-1
  [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks
  ☆71Updated this week
• kyegomez / PALI
  Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
  ☆89Updated last year
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆155Updated 3 months ago