Alternatives and similar repositories for whisperVideo

Users that are interested in whisperVideo are comparing it to the libraries listed below

• EvolvingLMMs-Lab / Aero-1
  ☆77Updated 8 months ago
• farewellthree / PPLLaVA
  Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"
  ☆131Updated last year
• chentuochao / Spatial-Speech-Translation
  The official repo for paper "Spatial Speech Translation: Translating Across Space With Binaural Hearables"
  ☆71Updated 5 months ago
• TencentARC / AudioStory
  AudioStory: Generating Long-Form Narrative Audio with Large Language Models
  ☆295Updated 4 months ago
• MiniMax-AI / MiniMax-AI.github.io
  The official GitHub Page for MiniMax
  ☆60Updated 2 months ago
• HumanMLLM / HumanOmniV2
  ☆146Updated 5 months ago
• AIGeeksGroup / PresentAgent
  [EMNLP 2025 Demo] PresentAgent: Multimodal Agent for Presentation Video Generation
  ☆123Updated last month
• showlab / livecc
  LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale (CVPR 2025)
  ☆366Updated 2 months ago
• multimodal-art-projection / AutoMV
  ☆78Updated 2 weeks ago
• google-deepmind / videoprism
  Official repository for "VideoPrism: A Foundational Visual Encoder for Video Understanding" (ICML 2024)
  ☆349Updated last week
• sieve-community / describe
  Incredibly descriptive audiovisual summaries for videos
  ☆41Updated last year
• hyc2026 / StoryTeller
  ☆82Updated 10 months ago
• 01yzzyu / wikiautogen
  [ICCV2025] WikiAutoGen offical page
  ☆23Updated 6 months ago
• umbertocappellazzo / Omni-AVSR
  Official Pytorch implementation of "Omni-AVSR: Towards Unified Multimodal Speech Recognition with Large Language Models" [IEEE ICASSP 202…
  ☆28Updated this week
• kszpxxzmc / ViSAudio
  ViSAudio: End-to-End Video-Driven Binaural Spatial Audio Generation
  ☆109Updated last month
• yannqi / Draw-an-Audio-Code
  Official code of the paper: Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesis.
  ☆45Updated last year
• bytedance / video-SALMONN-2
  video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…
  ☆141Updated last month
• Tencent-Hunyuan / HunyuanVision
  ☆93Updated 3 months ago
• AskYoutubeAI / AskVideos-VideoCLIP
  ☆81Updated last year
• PKU-YuanGroup / SwapAnyone
  An official implementation of SwapAnyone.
  ☆73Updated 10 months ago
• MiniMax-AI / audio-tools
  A collection of optimized utilities for text-to-audio processing, enhancing both training and inference workflows. This repository contai…
  ☆42Updated 9 months ago
• TIGER-AI-Lab / VideoGenHub
  A one-stop library to standardize the inference and evaluation of all the conditional video generation models.
  ☆50Updated 11 months ago
• yujxx / PodAgent
  PodAgent: A Comprehensive Framework for Podcast Generation
  ☆123Updated 8 months ago
• kyutai-labs / moshivis
  Kyutai with an "eye"
  ☆234Updated 9 months ago
• meituan-longcat / LongCat-Flash-Omni
  This is the official repo for the paper "LongCat-Flash-Omni Technical Report"
  ☆456Updated last week
• GAIR-NLP / LiveTalk
  ☆230Updated 2 weeks ago
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆165Updated 11 months ago
• invictus717 / InteractiveVideo
  InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions
  ☆132Updated last year
• eai-lab / On-device-Sora
  [arXiv] On-device Sora: Enabling Diffusion-Based Text-to-Video Generation for Mobile Devices
  ☆131Updated last month
• NVlabs / OmniVinci
  OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.
  ☆625Updated 2 months ago