lu-wo / whisbert
babyLM WhisBERT code
☆19Updated 11 months ago
Alternatives and similar repositories for whisbert:
Users that are interested in whisbert are comparing it to the libraries listed below
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆143Updated last year
- Official code for Wav2Seq☆96Updated 2 years ago
- ☆34Updated 3 years ago
- Datasets for turn-taking research☆12Updated last year
- Speech-MASSIVE is a multilingual Spoken Language Understanding (SLU) dataset comprising the speech counterpart for a portion of the MASSI…☆21Updated 7 months ago
- Collection of scripts from mHuBERT-147.☆24Updated 5 months ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆124Updated 4 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆200Updated 3 weeks ago
- This is a fork of the original fairseq repository (version 0.12.2) with added classes for training mHuBERT-147.☆17Updated 5 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆43Updated 10 months ago
- The Gridspace-Stanford Harper Valley speech dataset. Created in support of CS224S.☆45Updated 4 years ago
- ☆84Updated last year
- ☆20Updated 2 years ago
- Official release of StyleTalk dataset.☆62Updated 9 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆35Updated last year
- Explore different way to mix speech model(wav2vec2, hubert) and nlp model(BART,T5,GPT) together☆47Updated 2 years ago
- A mini, simple, and fast end-to-end automatic speech recognition toolkit.☆50Updated 2 years ago
- Repository containing the open source code of works published at the FBK MT unit.☆43Updated last week
- A toolkit for Spoken Language Understanding Evaluation (SLUE) benchmark. Refer paper https://arxiv.org/abs/2111.10367 for more details. O…☆64Updated last year
- This repository contains the implementation of the paper: "Span Classification with Structured Information for Disfluency Detection in Sp…☆12Updated last year
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated last year
- asr2k☆50Updated 10 months ago
- ASR text preprocessing utility☆21Updated 8 months ago
- ☆20Updated 2 years ago
- ☆56Updated 9 months ago
- ☆38Updated 7 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆56Updated 2 weeks ago
- 56 language, 1 model Multilingual ASR☆25Updated 3 years ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated 8 months ago
- ☆88Updated 2 weeks ago