lzw-lzw / UnifiedMLLM

Related projects ⓘ

Alternatives and complementary repositories for UnifiedMLLM

• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆69Updated 9 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated 3 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆50Updated last month
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆47Updated 6 months ago
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆32Updated 5 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM which strictly superset LLM embedded
  ☆30Updated 2 weeks ago
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆28Updated last month
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆27Updated 5 months ago
• ChocoWu / SeTok
  ☆36Updated last month
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆56Updated last year
• DAMO-NLP-SG / DiGIT
  [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
  ☆41Updated 3 weeks ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆52Updated 2 months ago
• scofield7419 / Video-of-Thought
  Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"
  ☆40Updated 4 months ago
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆30Updated 4 months ago
• Hon-Wong / ByteVideoLLM
  This is the official repo for the incoming work: ByteVideoLLM
  ☆14Updated 2 weeks ago
• zehanwang01 / OmniBind
  ☆25Updated last week
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆43Updated 11 months ago
• lucasjinreal / LLaVA-Magvit2
  ☆35Updated 5 months ago
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆14Updated last month
• Optimization-AI / fast_clip
  ☆19Updated last month
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆52Updated last year
• RifleZhang / LLaVA-Reasoner-DPO
  ☆29Updated this week
• Yaxin9Luo / Gamma-MOD
  Officail Repo of γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models
  ☆18Updated 3 weeks ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• zh460045050 / VQGAN-LC
  ☆102Updated 4 months ago
• UMass-Foundation-Model / FlexAttention
  ☆30Updated last month
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Multi-modal Models via Stage-wise Visual Context Compression
  ☆39Updated 3 months ago
• shuheikurita / RefEgo
  ☆12Updated 4 months ago
• Hritikbansal / videocon
  ☆55Updated 6 months ago
• mlfoundations / VisIT-Bench
  ☆45Updated last year