voidful / MMLM
Toward Multi Modality Language Model - implementation of GPT-4o/Project Astra
☆11Updated this week
Related projects ⓘ
Alternatives and complementary repositories for MMLM
- ☆10Updated 2 years ago
- ☆13Updated last month
- ASR text preprocessing utility☆20Updated 3 months ago
- Taiwanese Speech Synthesis with Tacotron2☆18Updated 2 years ago
- Unsupervised spoken sentence embeddings☆14Updated last year
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆25Updated 11 months ago
- Code for the method proposed in the paper:- ccc-wav2vec 2.0: Clustering aided Cross-Contrastive learning of Self-Supervised speech repres…☆16Updated 8 months ago
- This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language M…☆17Updated last year
- Code for T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5☆18Updated last year
- Taiwanese Translation with BERT based model and RNN. Collection of Taiwanese text corpus☆11Updated 2 years ago
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated last year
- ☆31Updated last year
- Code repository for the paper "Improving End-to-End SLU performance with Prosodic Attention and Distillation" accepted at Interspeech 202…☆23Updated last year
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆44Updated last year
- DUSTED: Spoken-Term Discovery using Discrete Speech Units☆13Updated last month
- AudioCodec-Hub is a Python library for encoding and decoding audio data, supporting various neural audio codec models☆22Updated last year
- Prosodic Speech Segmentation with Transformers☆23Updated 8 months ago
- ☆20Updated 3 years ago
- ☆41Updated last year
- Official implementation of MelHuBERT☆65Updated 3 weeks ago
- 56 language, 1 model Multilingual ASR☆24Updated 3 years ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆35Updated last month
- Textless (ASR-transcript free) Spoken Question Answering. The official release of NMSQA dataset and the implementation of "DUAL: Textless…☆34Updated last year
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆20Updated 3 months ago
- Transformer-based visually grounded speech models☆19Updated 2 years ago
- ☆13Updated last year
- ☆14Updated last year
- ☆12Updated 8 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- Syllable Segmentation and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Model☆30Updated last year