blmoistawinde / fenseLinks
Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval.
☆21Updated 2 years ago
Alternatives and similar repositories for fense
Users that are interested in fense are comparing it to the libraries listed below
Sorting:
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆42Updated 4 months ago
- ☆36Updated 2 years ago
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆19Updated 5 months ago
- Transformer-based visually grounded speech models☆19Updated 2 years ago
- Audio Captioning datasets for PyTorch.☆117Updated last week
- ☆79Updated last week
- Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'☆45Updated 3 years ago
- Audio captioning recipe☆47Updated 6 months ago
- Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.☆50Updated last month
- Web-crawl for "Audio Retrieval with WavText5K and CLAP Training"☆49Updated 2 years ago
- The open source code for LLM-Codec☆134Updated 9 months ago
- Code for T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5☆19Updated 2 years ago
- Official Implementation of "Prefix tuning for Automated Audio Captioning(ICASSP 2023)"☆30Updated last year
- Unsupervised phone and word segmentation using dynamic programming on self-supervised VQ features.☆37Updated last year
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆13Updated 2 years ago
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated last year
- DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning☆49Updated last year
- Non-Autoregressive Predictive Coding☆51Updated 4 years ago
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Updated 3 years ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆62Updated last month
- ARCH: Audio Representations benCHmark☆45Updated 9 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated 9 months ago
- ☆40Updated 2 years ago
- End-to-end Speech Translation☆36Updated 4 years ago
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)☆10Updated last month
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆35Updated last year
- ☆28Updated 2 years ago
- Tools for the evaluation of audio captioning.☆16Updated 5 years ago
- ☆12Updated 4 years ago