ckyang1124 / LALM-Evaluation-SurveyLinks
Collection of works for evaluating (and analyzing) large audio-language models (LALMs)
☆33Updated 3 weeks ago
Alternatives and similar repositories for LALM-Evaluation-Survey
Users that are interested in LALM-Evaluation-Survey are comparing it to the libraries listed below
Sorting:
- Source code for DM-Codec.☆48Updated 3 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆61Updated 10 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆60Updated 10 months ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆50Updated 3 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆50Updated last year
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆37Updated 5 months ago
- A Benchmark for Evaluating Turn-Taking and Overlap Handling in Full-Duplex Spoken Dialogue Models☆60Updated last week
- Code for DeSTA2.5-Audio☆108Updated 3 weeks ago
- The open source code for LLM-Codec☆138Updated last year
- The demo page for ALMTokenizer☆53Updated 4 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆85Updated 9 months ago
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆132Updated 5 months ago
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated last year
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆94Updated 6 months ago
- Official release of StyleTalk dataset.☆69Updated last year
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆60Updated 7 months ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Updated 9 months ago
- This repository contains the code for the paper "voc2vec: A Foundation Model for Non-Verbal Vocalization", accepted at ICASSP 2025.☆41Updated 4 months ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆57Updated 2 months ago
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆36Updated 2 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆98Updated 3 months ago
- ☆22Updated this week
- ☆79Updated last month
- The official repository for NonVerbalSpeech-38K.☆46Updated 3 weeks ago
- The open source code of ALMTokenizer2: Towards Low bit-rate and Semantic-rich Audio Tokenizer with Flow-based Scalar Diffusion Transforme…☆26Updated 3 months ago
- An automatic prosodic boundary annotation tool for Text-to-Speech Synthesis (TTS).☆49Updated last year
- ☆61Updated 10 months ago
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆89Updated 9 months ago
- DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning☆49Updated last year
- Survey on speech generation work.☆20Updated last year