slp-rl / SLM-Discrete-RepresentationsLinks
This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language Modeling" (ICASSP 2023)
☆19Updated 2 years ago
Alternatives and similar repositories for SLM-Discrete-Representations
Users that are interested in SLM-Discrete-Representations are comparing it to the libraries listed below
Sorting:
- ☆31Updated 2 years ago
- Official implementation of MelHuBERT☆68Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆57Updated 4 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆48Updated 2 years ago
- Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11…☆46Updated last year
- A spoken version of the textual story cloze benchmark☆19Updated 2 years ago
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Updated 2 years ago
- ☆13Updated last year
- ☆41Updated 2 years ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Updated 2 years ago
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated last year
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆75Updated 4 months ago
- ASR text preprocessing utility☆21Updated last year
- Collection of scripts from mHuBERT-147.☆32Updated 11 months ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Updated 11 months ago
- ☆64Updated 3 years ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆77Updated 2 years ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆66Updated last year
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆61Updated 2 years ago
- Official implementation of the paper "Laughter Synthesis using Pseudo Phonetic Tokens with a Large-scale In-the-wild Laughter Corpus" acc…☆76Updated 2 years ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆39Updated last year
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆47Updated 3 months ago
- Transformer-based visually grounded speech models☆19Updated 3 years ago
- A Benchmark for Evaluating Turn-Taking and Overlap Handling in Full-Duplex Spoken Dialogue Models☆98Updated last month
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆82Updated 2 years ago
- ☆43Updated last year
- DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning☆49Updated last year
- Code for T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5☆19Updated 2 years ago
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated 2 years ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆38Updated last year