Identifying "who speak when" using visual speech input and pretrained lip-sync expert
☆18Jul 1, 2023Updated 3 years ago
Alternatives and similar repositories for syncnet-speaker-diarization
Users that are interested in syncnet-speaker-diarization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NegVSR: Augmenting Negatives for Generalized Noise Modeling in Real-world Video Super-Resolution. Real-world, video super-resolution, ima…☆12Apr 5, 2024Updated 2 years ago
- ☆10Feb 17, 2023Updated 3 years ago
- [WACV 2026 Oral] LASER: Lip Landmark Assisted Speaker Detection for Robustness official implemntation☆30Feb 26, 2026Updated 6 months ago
- ☆10Nov 19, 2023Updated 2 years ago
- ☆29Oct 1, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆27Jun 27, 2023Updated 3 years ago
- 一个通过模型分离音频中的乐器，再重新混合 以达到立体声转5.1声道&7.1声道的效果的工具☆17May 21, 2026Updated 4 months ago
- wav2lip in a Vector Quantized (VQ) space☆27Jun 20, 2023Updated 3 years ago
- pgvector support for C++☆26Jul 18, 2026Updated 2 months ago
- [Interspeech 2026] Revisiting Active Speaker Detection: An In-the-Wild Benchmark for Generalization and Robustness☆24Jun 25, 2026Updated 2 months ago
- SyncNet for Time Synchronization☆30Mar 13, 2023Updated 3 years ago
- ☆24Oct 8, 2021Updated 4 years ago
- Considering the original Wav2Lip was trained on LSR2 and didn't have good performance on Chinese. I preprocessed CMLR Dataset and would t…☆63Sep 23, 2023Updated 2 years ago
- Audio-visual diarization pipeline used for creating VoxConverse dataset☆22Jun 6, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 这是一个在wav2lip，使用wav2lip、gfpgan、yolov5等模型用RT加速的超快推理！经测试在2070显卡上可达到0.03秒每帧实现实时推理。☆32Sep 23, 2025Updated 11 months ago
- Code release for paper: The Boombox: Visual Reconstruction from Acoustic Vibrations☆15May 18, 2021Updated 5 years ago
- PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)☆25Mar 9, 2024Updated 2 years ago
- Optimized Syncnet and Chinese enhanced version, EN and CN checkpoints released☆11Nov 8, 2021Updated 4 years ago
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆28Aug 30, 2024Updated 2 years ago
- code repo for LoCoNet: Long-Short Context Network for Active Speaker Detection☆60May 1, 2023Updated 3 years ago
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆29Oct 18, 2024Updated last year
- The code for AAAI 2025 “Large Language Models Are Read/Write Policy-Makers for Simultaneous Generation”☆15Jan 3, 2025Updated last year
- ☆24May 11, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆12Sep 1, 2024Updated 2 years ago
- Efficient Geometry-aware 3D Generative Adversarial Networks (EG3D)☆17Jul 15, 2022Updated 4 years ago
- Disentangled Speech Embeddings using Cross-Modal Self-Supervision☆167Apr 12, 2020Updated 6 years ago
- 复现Wav2Lip作者新的论文☆20Jun 20, 2023Updated 3 years ago
- Personalized Lip Reading: Adapting to Your Unique Lip Movements with Vision and Language (AAAI 2025)☆24Jun 29, 2026Updated 2 months ago
- Fast instruction tuning with Llama2☆10Apr 8, 2024Updated 2 years ago
- wav2lip训练数据预处理综合工具☆40Nov 18, 2023Updated 2 years ago
- 基于wav2lip进行虚拟数字人训练，唇形驱动，包括数据处理流程等，模型包括96x96，192x192，192x288，288x288。☆22May 7, 2024Updated 2 years ago
- The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…☆10Oct 12, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- simple and fast wav2lip using onnx models for face-detection and inference. Easy installation☆31Oct 14, 2024Updated last year
- Official source code for the paper "Tailored Design of Audio-Visual Speech Recognition Models using Branchformers"☆15Feb 24, 2025Updated last year
- An unofficial (PyTorch) implementation for the paper Deep Lip Reading: A comparison of models and an online application.☆10May 13, 2020Updated 6 years ago
- AlignNet: A Unifying Approach to Audio-Visual Alignment (WACV 2020)☆34Jan 10, 2021Updated 5 years ago
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" [IEEE MLSP 2024] …☆42Jul 31, 2024Updated 2 years ago
- Wav2Lip model Windows GUI Program using PyQT5☆19Jun 4, 2021Updated 5 years ago
- LCM OpenVINO model converter☆24Mar 27, 2024Updated 2 years ago