voidful / MMLM
Toward Multi Modality Language Model - implementation of GPT-4o/Project Astra
☆14Updated 5 months ago
Alternatives and similar repositories for MMLM
Users that are interested in MMLM are comparing it to the libraries listed below
Sorting:
- ☆13Updated 7 months ago
- ☆10Updated 2 years ago
- ASR text preprocessing utility☆21Updated 9 months ago
- Taiwanese Speech Synthesis with Tacotron2☆19Updated 2 years ago
- Code for T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5☆19Updated 2 years ago
- Textless (ASR-transcript free) Spoken Question Answering. The official release of NMSQA dataset and the implementation of "DUAL: Textless…☆35Updated last year
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated last year
- ☆62Updated last month
- Official implementation of MelHuBERT☆65Updated 6 months ago
- This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language M…☆18Updated 2 years ago
- AudioCodec-Hub is a Python library for encoding and decoding audio data, supporting various neural audio codec models☆22Updated last year
- ☆31Updated last year
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆52Updated last year
- ☆15Updated 3 years ago
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated last year
- Code：Completely Unsupervised Speech Recognition By A Generative Adversarial Network Harmonized With Iteratively Refined Hidden Markov Mod…☆25Updated 5 years ago
- Unsupervised spoken sentence embeddings☆14Updated 2 years ago
- Transformer-based visually grounded speech models☆19Updated 2 years ago
- fine-tune Whipser model for Taiwanese speech recognition☆29Updated 2 years ago
- Taiwanese Translation with BERT based model and RNN. Collection of Taiwanese text corpus☆11Updated 2 years ago
- Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"☆86Updated 2 months ago
- DUSTED: Spoken-Term Discovery using Discrete Speech Units☆17Updated 7 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- Prosodic Speech Segmentation with Transformers☆25Updated last year
- Code for the paper: How Much Context Does My Attention-Based ASR System Need?☆11Updated 2 weeks ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆35Updated last year
- REBORN: Reinforcement-Learned Boundary Segmentation with Iterative Training for Unsupervised ASR☆11Updated 5 months ago
- Code for the method proposed in the paper:- ccc-wav2vec 2.0: Clustering aided Cross-Contrastive learning of Self-Supervised speech repres…☆21Updated last year
- DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning☆49Updated last year
- ☆16Updated last year