[ACL 2025] Predicting Turn-Taking and Backchannel in Human-Machine Conversations Using Linguistic, Acoustic, and Visual Signals
☆37Aug 11, 2025Updated last year
Alternatives and similar repositories for MM-F2F
Users that are interested in MM-F2F are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vad☆29Apr 3, 2023Updated 3 years ago
- ☆17Apr 12, 2021Updated 5 years ago
- TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog☆74May 18, 2024Updated 2 years ago
- ☆15May 20, 2025Updated last year
- Llama-Mimi is a speech language model that uses a unified tokenizer (Mimi) and a single Transformer decoder (Llama) to jointly model sequ…☆31Sep 20, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Official implementation of "Wave-Trainer-Fit: Neural Vocoder with Trainable Prior and Fixed-Point Iteration towards High-Quality Speech G…☆16Feb 6, 2026Updated 9 months ago
- Voice Activity Projection Models: Self-supervised learning of Turn-taking Events☆128May 29, 2024Updated 2 years ago
- ☆33Sep 24, 2026Updated last month
- ☆13May 11, 2026Updated 5 months ago
- Datasets for turn-taking research☆22Dec 21, 2023Updated 2 years ago
- ☆40Apr 3, 2025Updated last year
- A real-time implementation of Voice Activity Projection (VAP) is aimed at controlling behaviors of spoken dialogue systems, such as turn-…☆114Jul 24, 2025Updated last year
- ☆16Jun 25, 2024Updated 2 years ago
- ☆14Jun 3, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆15Feb 9, 2023Updated 3 years ago
- ☆24Sep 20, 2024Updated 2 years ago
- Behavioral probing of language acquisition models at the lexical and syntactic level☆20Jul 17, 2023Updated 3 years ago
- [ACL 2026] VoxMind: An End-to-End Agentic Spoken Dialogue System☆46Jul 8, 2026Updated 3 months ago
- This repository contains the training code from paper "SpidR Learning Fast and Stable Linguistic Units for Spoken Language Models Without…☆60Updated this week
- Menagerie of video models trained on various video datasets☆11Oct 13, 2024Updated 2 years ago
- Source code and speech samples for the DSU-AVO paper accepted to INTERSPEECH 2023☆12May 13, 2024Updated 2 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆17Jun 16, 2024Updated 2 years ago
- Benchmark forced alignment models (Qwen3-FA, WhisperX, Seamless UnitY2) on FLEURS via implicit WER on cropped audio.☆17Jun 25, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆22Mar 6, 2026Updated 8 months ago
- ☆23Sep 14, 2025Updated last year
- ☆17Jul 4, 2024Updated 2 years ago
- Preference-supervised naturalness scorer for modern neural TTS . best way to measure naturalness☆21May 29, 2026Updated 5 months ago
- Official Implementation of NAACL 2025 Paper: Behavior-SD: Behaviorally Aware Spoken Dialogue Generation with Large Language Models☆19Apr 30, 2025Updated last year
- ☆10Dec 22, 2023Updated 2 years ago
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆20Aug 20, 2026Updated 2 months ago
- High-performance, semantic turn detection for conversational AI☆48Oct 1, 2025Updated last year
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆52Apr 7, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This is the code and dataset repo for Interspeech 2024 paper "Target conversation extraction: Source separation using turn-taking dynamic…☆59Aug 15, 2025Updated last year
- Revisiting Denoising Diffusion Probabilistic Models for Speech Enhancement: Condition Collapse, Efficiency and Refinement, Thirty-Seventh…☆48Dec 5, 2023Updated 2 years ago
- Real-time Turn-taking, Backchannel, and Head-nodding Prediction for Full-duplex Interaction☆162Oct 20, 2026Updated 2 weeks ago
- [INTERSPEECH 2024] Official pytorch code for the paper "Disentangled Representation Learning for Environment-agnostic Speaker Recognition…☆20Jul 23, 2024Updated 2 years ago
- ☆36Oct 2, 2026Updated last month
- ☆13Nov 5, 2024Updated 2 years ago
- ☆23Oct 6, 2026Updated last month