[ACL 2025] Predicting Turn-Taking and Backchannel in Human-Machine Conversations Using Linguistic, Acoustic, and Visual Signals
☆37Aug 11, 2025Updated last year
Alternatives and similar repositories for MM-F2F
Users that are interested in MM-F2F are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Llama-Mimi is a speech language model that uses a unified tokenizer (Mimi) and a single Transformer decoder (Llama) to jointly model sequ…☆31Sep 20, 2025Updated last year
- Voice Activity Projection Models: Self-supervised learning of Turn-taking Events☆123May 29, 2024Updated 2 years ago
- Official implementation of "Wave-Trainer-Fit: Neural Vocoder with Trainable Prior and Fixed-Point Iteration towards High-Quality Speech G…☆16Feb 6, 2026Updated 8 months ago
- ☆17Apr 12, 2021Updated 5 years ago
- ☆15May 20, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆40Apr 3, 2025Updated last year
- ☆16Jun 25, 2024Updated 2 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆17Jun 16, 2024Updated 2 years ago
- ☆24Sep 20, 2024Updated 2 years ago
- ☆21Mar 6, 2026Updated 7 months ago
- ☆32Sep 24, 2026Updated 3 weeks ago
- Behavioral probing of language acquisition models at the lexical and syntactic level☆20Jul 17, 2023Updated 3 years ago
- This repository contains the training code from paper "SpidR Learning Fast and Stable Linguistic Units for Spoken Language Models Without…☆59Updated this week
- ☆23Sep 14, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Menagerie of video models trained on various video datasets☆10Oct 13, 2024Updated 2 years ago
- Datasets for turn-taking research☆22Dec 21, 2023Updated 2 years ago
- Official Implementation of NAACL 2025 Paper: Behavior-SD: Behaviorally Aware Spoken Dialogue Generation with Large Language Models☆19Apr 30, 2025Updated last year
- ☆10Dec 22, 2023Updated 2 years ago
- High-performance, semantic turn detection for conversational AI☆47Oct 1, 2025Updated last year
- Real-time Turn-taking, Backchannel, and Head-nodding Prediction for Full-duplex Interaction☆156Updated this week
- ☆13Feb 16, 2024Updated 2 years ago
- ☆23Oct 6, 2026Updated last week
- Text-To-Speech for NotebookLM☆39Jul 20, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog☆74May 18, 2024Updated 2 years ago
- ☆15Nov 26, 2024Updated last year
- [ICLR 2025] Highly Efficient Self-Adaptive Reward Shaping for Reinforcement Learning (SASR)☆12Aug 26, 2025Updated last year
- ☆13Jan 28, 2022Updated 4 years ago
- vad☆29Apr 3, 2023Updated 3 years ago
- Meanflow and multilingual for F5-TTS model☆16Aug 23, 2025Updated last year
- The official repository TimeAudio, a comprehensive framework that incorporates fine-grained acoustic cues into LALMs with enhanced module…☆31Nov 18, 2025Updated 10 months ago
- A real-time implementation of Voice Activity Projection (VAP) is aimed at controlling behaviors of spoken dialogue systems, such as turn-…☆114Jul 24, 2025Updated last year
- CoNeTTE: An efficient Audio Captioning system leveraging multiple datasets with Task Embedding☆23Dec 17, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Samsone: A Family of Open Small Audio Language Models for On-Device Inference☆45Sep 28, 2026Updated 2 weeks ago
- ☆23Apr 5, 2026Updated 6 months ago
- PyTorch implementation of USR 2.0 (ICLR 2026)☆17Sep 9, 2026Updated last month
- ☆17Aug 19, 2023Updated 3 years ago
- Implementation of the paper "Variable Bitrate Residual Vector Quantization for Audio Coding"☆11Apr 10, 2025Updated last year
- StimulerVoiceX is a denoising and speech enhancement system. It uses deep learning techniques to remove noise from speech signals and imp…☆14Jul 19, 2023Updated 3 years ago
- [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation☆31Sep 6, 2024Updated 2 years ago