Alternatives and similar repositories for Omni-Emotion

Users that are interested in Omni-Emotion are comparing it to the libraries listed below

• zeroQiaoba / gpt4v-emotion
  GPT-4V with Emotion
  ☆92Updated last year
• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆53Updated 8 months ago
• aimmemotion / EmoVIT
  [CVPR 2024] EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning
  ☆31Updated 3 weeks ago
• zeroQiaoba / AffectGPT
  Explainable Multimodal Emotion Reasoning (EMER), Open-vocabulary MER (OV-MER), and AffectGPT
  ☆166Updated last week
• OmniMMI / OpenOmniNexus
  a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
  ☆14Updated last month
• RainBowLuoCS / OpenOmni
  OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…
  ☆49Updated this week
• MC-EIU / MC-EIU
  ☆21Updated 2 weeks ago
• thuiar / TCL-MAP
  TCL-MAP is a powerful method for multimodal intent recognition (AAAI 2024)
  ☆42Updated last year
• yannqi / COMBO-AVS
  [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…
  ☆39Updated 3 weeks ago
• sunlicai / HiCMAE
  [Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition
  ☆106Updated 6 months ago
• XuecWu / eMotions
  [ACM ICMR'25]Official repository for "eMotions: A Large-Scale Dataset for Emotion Recognition in Short Videos"
  ☆33Updated 11 months ago
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆22Updated 9 months ago
• BriansIDP / video-SALMONN-o1
  ☆28Updated this week
• thuiar / MIntRec2.0
  MIntRec2.0 is the first large-scale dataset for multimodal intent recognition and out-of-scope detection in multi-party conversations (IC…
  ☆47Updated 2 weeks ago
• NUSTM / UniVA
  A Unimodal Valence-Arousal Driven Contrastive Learning Framework for Multimodal Multi-Label Emotion Recognition (ACM MM 2024 oral)
  ☆20Updated 6 months ago
• SpeechEE / SpeechEE
  ☆11Updated 2 months ago
• GeWu-Lab / LFAV
  Towards Long Form Audio-visual Video Understanding
  ☆15Updated 2 weeks ago
• threegold116 / Awesome-Omni-MLLMs
  A collection of omni-mllm
  ☆28Updated this week
• chengzju / CARAT
  ☆21Updated last month
• the-anonymous-bs / av-SALMONN
  av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models
  ☆13Updated last year
• GeWu-Lab / Crab
  ☆20Updated last month
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆38Updated last month
• schowdhury671 / meerkat
  ☆28Updated 7 months ago
• Xeaver / EmotionCLIP
  [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"
  ☆48Updated 2 months ago
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆24Updated 4 months ago
• JeongHun0716 / MMS-LLaMA
  Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…
  ☆25Updated last month
• GeWu-Lab / MMCosine_ICASSP23
  The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"
  ☆19Updated last year
• LoieSun / Auto-ACD
  code for A Large-scale Dataset for Audio-Language Representation Learning
  ☆13Updated 7 months ago
• HumanMLLM / HumanOmni
  HumanOmni
  ☆161Updated 2 months ago
• Jack-ZC8 / M3AV-dataset
  [ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
  ☆14Updated last month