Alternatives and similar repositories for UMOE-Scaling-Unified-Multimodal-LLMs:

Users that are interested in UMOE-Scaling-Unified-Multimodal-LLMs are comparing it to the libraries listed below

• HJYao00 / Mulberry
  Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS
  ☆618Updated this week
• PKU-Alignment / align-anything
  Align Anything: Training All-modality Model with Feedback
  ☆2,154Updated this week
• EvolvingLMMs-Lab / lmms-eval
  Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
  ☆2,116Updated this week
• om-ai-lab / OmAgent
  Build multimodal language agents for fast prototype and production
  ☆1,777Updated this week
• Vchitect / Vchitect-2.0
  Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models
  ☆885Updated 3 weeks ago
• Yuliang-Liu / Monkey
  【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models
  ☆1,708Updated this week
• PKU-YuanGroup / Machine-Mindset
  An MBTI Exploration of Large Language Models
  ☆457Updated last year
• showlab / Show-1
  [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation
  ☆1,004Updated 3 months ago
• ShareGPT4Omni / ShareGPT4Video
  [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
  ☆1,039Updated 4 months ago
• Langboat / Mengzi3
  ☆1,381Updated 4 months ago
• Alpha-Innovator / DocGenome
  DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models
  ☆127Updated last month
• AlaaLab / InstructCV
  [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"
  ☆460Updated 9 months ago
• lerogo / MMGenBench
  Official repository of MMGenBench
  ☆119Updated 3 months ago
• mlpc-ucsd / BLIVA
  (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
  ☆253Updated 10 months ago
• gordonhu608 / MQT-LLaVA
  [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models
  ☆96Updated 7 months ago
• Alpha-Innovator / Chimera
  Improving Generalist Model with Domain-Specific Experts
  ☆82Updated last month
• Zefan-Cai / KVCache-Factory
  Unified KV Cache Compression Methods for Auto-Regressive Models
  ☆886Updated last month
• hitsz-ids / synthetic-data-generator
  SDG is a specialized framework designed to generate high-quality structured tabular data.
  ☆2,308Updated last week
• Everlyn-Labs / Wasserstein-VQ
  ☆158Updated 4 months ago
• jishengpeng / WavTokenizer
  SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling
  ☆1,026Updated last month
• Everlyn-Labs / ANTRP
  Intervening Anchor Token: Decoding Strategy in Alleviating Hallucinations for MLLMs
  ☆148Updated 4 months ago
• om-ai-lab / OmDet
  Real-time and accurate open-vocabulary end-to-end object detection
  ☆1,167Updated 2 months ago
• Alpha-Innovator / AdaptiveDiffusion
  [NeurIPS'24] Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy
  ☆61Updated 3 weeks ago
• lxtGH / OMG-Seg
  OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]
  ☆1,231Updated 2 months ago
• YUCHEN005 / GenTranslate
  Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"
  ☆193Updated 6 months ago
• 360CVGroup / FancyVideo
  Video generation from text&image, 1st-gen
  ☆745Updated last week
• Text-to-Audio / AudioLCM
  PyTorch Implementation of AudioLCM (ACM-MM'24): a efficient and high-quality text-to-audio generation with latent consistency model.
  ☆873Updated 2 months ago
• GreenBitAI / bitorch-engine
  A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.
  ☆196Updated 7 months ago