voidful / MMLMLinks
Toward Multi Modality Language Model - implementation of GPT-4o/Project Astra
☆16Updated 8 months ago
Alternatives and similar repositories for MMLM
Users that are interested in MMLM are comparing it to the libraries listed below
Sorting:
- ☆10Updated 2 years ago
- ASR text preprocessing utility☆21Updated last year
- ☆13Updated 11 months ago
- Taiwanese Speech Synthesis with Tacotron2☆21Updated 2 years ago
- Unsupervised spoken sentence embeddings☆14Updated 2 years ago
- Code for the method proposed in the paper:- ccc-wav2vec 2.0: Clustering aided Cross-Contrastive learning of Self-Supervised speech repres…☆21Updated last year
- Textless (ASR-transcript free) Spoken Question Answering. The official release of NMSQA dataset and the implementation of "DUAL: Textless…☆35Updated 2 years ago
- Code for T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5☆19Updated 2 years ago
- This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language M…☆19Updated 2 years ago
- Official implementation of MelHuBERT☆66Updated 10 months ago
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated last year
- A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenizat…☆88Updated this week
- ☆32Updated 2 years ago
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated 2 years ago
- ☆41Updated 2 years ago
- Code repository for the paper "Improving End-to-End SLU performance with Prosodic Attention and Distillation" accepted at Interspeech 202…☆27Updated 2 years ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆57Updated 2 months ago
- ☆14Updated 2 years ago
- Prosodic Speech Segmentation with Transformers☆26Updated last year
- Code：Completely Unsupervised Speech Recognition By A Generative Adversarial Network Harmonized With Iteratively Refined Hidden Markov Mod…☆25Updated 5 years ago
- DUSTED: Spoken-Term Discovery using Discrete Speech Units☆17Updated 10 months ago
- This repository contains all the code necessary for running the multilingual distilwhisper from Ferraz et al. 2024 IEEE ICASSP paper.☆28Updated last year
- Collection of scripts from mHuBERT-147.☆29Updated 9 months ago
- Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11…☆46Updated last year
- ☆15Updated 3 years ago
- ☆14Updated last year
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆56Updated 2 years ago
- 56 language, 1 model Multilingual ASR☆25Updated 4 years ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆47Updated last year
- A handy dataset of noises for ASR☆22Updated 6 years ago