Alternatives and similar repositories for Pengi

Users that are interested in Pengi are comparing it to the libraries listed below

• YuanGongND / ltu
  Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".
  ☆440Updated last year
• XinhaoMei / WavCaps
  This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.
  ☆232Updated 10 months ago
• AudioLLMs / AudioBench
  AudioBench: A Universal Benchmark for Audio Large Language Models
  ☆227Updated this week
• Labbeti / aac-datasets
  Audio Captioning datasets for PyTorch.
  ☆119Updated 3 weeks ago
• facebookresearch / speech-resynthesis
  An official reimplementation of the method described in the INTERSPEECH 2021 paper - Speech Resynthesis from Discrete Disentangled Self-S…
  ☆406Updated last year
• ZhangXInFD / SpeechTokenizer
  This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…
  ☆569Updated last year
• cdjkim / audiocaps
  🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps
  ☆175Updated 3 months ago
• voidful / Codec-SUPERB
  Audio Codec Speech processing Universal PERformance Benchmark
  ☆258Updated 2 months ago
• glory20h / VoiceLDM
  VoiceLDM: Text-to-Speech with Environmental Context
  ☆178Updated 10 months ago
• liusongxiang / Large-Audio-Models
  Keep track of big models in audio domain, including speech, singing, music etc.
  ☆484Updated 8 months ago
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆161Updated last month
• haoheliu / AudioLDM-training-finetuning
  AudioLDM training, finetuning, evaluation and inference.
  ☆253Updated 6 months ago
• yangdongchao / UniAudio
  The Open Source Code of UniAudio
  ☆568Updated 11 months ago
• wavlab-speech / versa
  Versatile Evaluation of Speech and Audio
  ☆282Updated this week
• microsoft / UniSpeech
  UniSpeech - Large Scale Self-Supervised Learning for Speech
  ☆463Updated last year
• Sreyan88 / GAMA
  Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
  ☆131Updated 6 months ago
• microsoft / CLAP
  Learning audio concepts from natural language supervision
  ☆564Updated 9 months ago
• ddlBoJack / Awesome-Speech-Pretraining
  Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.
  ☆206Updated last year
• Zain-Jiang / Speech-Editing-Toolkit
  It's a repository for implementations of neural speech editing algorithms.
  ☆198Updated last year
• facebookresearch / AudioMAE
  This repo hosts the code and models of "Masked Autoencoders that Listen".
  ☆593Updated last year
• YuanGongND / vocalsound
  Dataset and baseline code for the VocalSound dataset (ICASSP2022).
  ☆142Updated 2 years ago
• jishengpeng / WavChat
  A Survey of Spoken Dialogue Models (60 pages)
  ☆303Updated 6 months ago
• X-LANCE / VoiceFlow-TTS
  [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"
  ☆346Updated 9 months ago
• JeffC0628 / awesome-voice-conversion
  A curated list of awesome voice conversion, projects and communities.
  ☆236Updated 5 months ago
• kaistmm / Audio-Mamba-AuM
  Official Implementation of the work "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning"
  ☆144Updated 6 months ago
• lifeiteng / naturalspeech3_facodec
  FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3
  ☆201Updated last year
• dynamic-superb / dynamic-superb
  The official repository of Dynamic-SUPERB.
  ☆183Updated last month
• 0nutation / USLM
  Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)
  ☆145Updated last year
• MorenoLaQuatra / audiocaps-download
  This package aims at simplifying the download of the AudioCaps dataset.
  ☆35Updated last year
• thuhcsi / SECap
  ☆165Updated 11 months ago