slp-rl / SLM-Discrete-Representations
This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language Modeling" (ICASSP 2023)
☆17Updated last year
Related projects ⓘ
Alternatives and complementary repositories for SLM-Discrete-Representations
- A spoken version of the textual story cloze benchmark☆14Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆35Updated last month
- ☆31Updated last year
- ☆13Updated last month
- Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11…☆42Updated 4 months ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆44Updated last year
- AudioCodec-Hub is a Python library for encoding and decoding audio data, supporting various neural audio codec models☆22Updated last year
- ☆41Updated last year
- The official code for the SALMon🍣 benchmark☆40Updated 2 months ago
- ☆32Updated 2 months ago
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆46Updated last year
- Aty-TTS: Improving fairness for spoken language understanding in atypical speech with Text-to-Speech☆10Updated 11 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆31Updated 10 months ago
- Just another FastSpeech 2 but cleaner code :)☆25Updated 4 months ago
- Code for T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5☆18Updated last year
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- Prosodic Speech Segmentation with Transformers☆23Updated 8 months ago
- DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning☆47Updated 10 months ago
- Temporary anonymous version☆22Updated 8 months ago
- Python scripts to create noisy and reverberant 2-speaker mixture audio with Libri-Light and WHAM☆15Updated 2 weeks ago
- Official implementation of MelHuBERT☆65Updated 3 weeks ago
- The implementation of paper "SpeechTripleNet: End-to-End Disentangled Speech Representation Learning for Content, Timbre and Prosody"☆29Updated 11 months ago
- Official implementation of the paper "Laughter Synthesis using Pseudo Phonetic Tokens with a Large-scale In-the-wild Laughter Corpus" acc…☆71Updated last year
- PyTorch Implementation of ViT-TTS (EMNLP'23)☆10Updated last year
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆47Updated last month
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆15Updated this week
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆20Updated 3 months ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆38Updated 2 months ago