Alternatives and similar repositories for Omni-Emotion:

Users that are interested in Omni-Emotion are comparing it to the libraries listed below

• aimmemotion / EmoVIT
  [CVPR 2024] EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning
  ☆29Updated 6 months ago
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆21Updated 7 months ago
• RainBowLuoCS / OpenOmni
  OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…
  ☆40Updated 2 weeks ago
• threegold116 / Awesome-Omni-MLLMs
  A collection of omni-mllm
  ☆16Updated this week
• zeroQiaoba / gpt4v-emotion
  GPT-4V with Emotion
  ☆89Updated last year
• zeroQiaoba / AffectGPT
  Explainable Multimodal Emotion Reasoning (EMER) and AffectGPT
  ☆144Updated 11 months ago
• GeWu-Lab / LFAV
  Towards Long Form Audio-visual Video Understanding
  ☆13Updated 5 months ago
• BriansIDP / video-SALMONN-o1
  ☆23Updated this week
• MC-EIU / MC-EIU
  ☆17Updated 9 months ago
• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆52Updated 7 months ago
• JaaackHongggg / WorldSense
  WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  ☆19Updated last month
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆61Updated last year
• yannqi / COMBO-AVS
  [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…
  ☆39Updated 8 months ago
• schowdhury671 / meerkat
  ☆27Updated 5 months ago
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆32Updated 2 weeks ago
• HumanMLLM / HumanOmni
  HumanOmni
  ☆137Updated 3 weeks ago
• Haoqiu-Yan / PerceptiveAgent
  Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))
  ☆42Updated 7 months ago
• Jack-ZC8 / M3AV-dataset
  [ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
  ☆14Updated 6 months ago
• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆23Updated 2 weeks ago
• SpeechEE / SpeechEE
  ☆11Updated last month
• GalaxyCong / DubFlow
  Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.
  ☆12Updated 2 months ago
• MCR-PEFT / Ex-MCR
  ☆42Updated last year
• GeWu-Lab / MMCosine_ICASSP23
  The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"
  ☆19Updated last year
• thuiar / TCL-MAP
  TCL-MAP is a powerful method for multimodal intent recognition (AAAI 2024)
  ☆38Updated last year
• Exploring-Embodied-Emotion-official / E3
  ☆13Updated 9 months ago
• scofield7419 / EmpathyEar
  Multimodal Empathetic Chatbot
  ☆36Updated 8 months ago
• sunlicai / HiCMAE
  [Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition
  ☆100Updated 5 months ago
• XuecWu / eMotions
  Official repository for "eMotions: A Large-Scale Dataset for Emotion Recognition in Short Videos"
  ☆33Updated 9 months ago
• NEU-DataMining / awesome-affective-computing
  A comprehensive overview of affective computing research in the era of large language models (LLMs).
  ☆22Updated 7 months ago
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆34Updated 6 months ago