The official implementation of ImageBind-LLM and Whisper-LLM from the paper "Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech".
☆20Oct 30, 2023Updated 2 years ago
Alternatives and similar repositories for multimodal-llama
Users that are interested in multimodal-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AdvSV stands as the first dataset developed specifically for evaluating Speaker Verification (SV) systems against adversarial attacks. I…☆11Nov 21, 2023Updated 2 years ago
- Comprehensive quantitative comparison of lossless and lossy audio codecs☆41Feb 11, 2023Updated 3 years ago
- Code for paper "Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI"☆13Jan 19, 2024Updated 2 years ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆58Apr 17, 2024Updated 2 years ago
- This is the implementation of the paper "Adversarial Attacks on Spoofing Countermeasures of automatic speaker verification".☆42Mar 9, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11May 7, 2022Updated 4 years ago
- This repository is the open source code for our latest feasibility work: "Human Anomalous Gait Termination Recognition Via Through-the-Wa…☆30Jun 4, 2025Updated last year
- A survey of spoken dialogue models (SDMs) with speech input and speech output. Focus on their Intermediate Representation and Generation …☆31Mar 24, 2026Updated 4 months ago
- Official repository for the paper Singing Voice Graph Modeling for SingFake Detection (Interspeech 2024).☆24Sep 19, 2025Updated 10 months ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Nov 19, 2024Updated last year
- This is the repository of through-the-wall radar human activity recognition using multi-sampling convolutional neural networks (MSCNN). A…☆10Aug 5, 2025Updated last year
- AffectSpeech: A Large-Scale Emotional Speech Dataset with Fine-Grained Textual Descriptions for Speech Emotion Captioning and Synthesis☆69Jun 12, 2026Updated 2 months ago
- Super Flappy Bird in p5.js☆10Mar 8, 2021Updated 5 years ago
- ☆14Dec 15, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The alignment of feature distributions between visible and thermal domains is crucial for achieving effective object detection. Our propo…☆14Jul 16, 2025Updated last year
- Official implementation of the ICASSP 2023 paper "HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields"☆28Dec 3, 2023Updated 2 years ago
- A casual and simple ChatGPT Python script that can run using terminal (as long as you have an API). Support Azure API.☆20May 3, 2025Updated last year
- Learning Deep Multi-Level Similarity for Thermal Infrared Object Tracking☆11Mar 18, 2021Updated 5 years ago
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆272May 19, 2024Updated 2 years ago
- ☆11Mar 29, 2021Updated 5 years ago
- A PyTorch implementation of the paper "Visualizing and understanding convolutional networks"☆14Feb 19, 2018Updated 8 years ago
- COG-MHEAR Audio-Visual Speech Enhancement Challenge☆48Feb 17, 2026Updated 5 months ago
- ☆15Sep 9, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official repository for the paper Multimodal Transformer Distillation for Audio-Visual Synchronization (ICASSP 2024).☆29Apr 3, 2024Updated 2 years ago
- A Pytorch implementation of the paper : SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classification☆34Jun 25, 2021Updated 5 years ago
- This is an Ai based Yoga Pose Detection System☆10Jul 5, 2022Updated 4 years ago
- paddlepaddle框架 论文复现（CNN特征可视化）+VGG16猫脸分类（动态图）☆17Jul 29, 2020Updated 6 years ago
- a simple repo for some references about thermal infrared object detection☆16Jul 31, 2022Updated 4 years ago
- ☆20Feb 15, 2023Updated 3 years ago
- The demo for "Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem".☆12Oct 25, 2021Updated 4 years ago
- Implementation for the SenSys24 paper mmCLIP: Boosting mmWave-based Zero-shot HAR via Signal-Text Alignment.☆18Nov 16, 2024Updated last year
- Source code for "BLOOM-Net: Blockwise Optimization for Masking Networks Toward Scalable and Efficient Speech Enhancement"☆14Feb 13, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Random collections of my interested research papers / projects☆20May 20, 2021Updated 5 years ago
- The official repository of Dynamic-SUPERB.☆200Jun 24, 2025Updated last year
- Multimodal Instruction Tuning for Llama 3☆52Apr 25, 2024Updated 2 years ago
- ☆13Nov 16, 2020Updated 5 years ago
- 很久以前写的人生倒计时工具，由于博客内无法运行，拿出来☆11Jun 9, 2022Updated 4 years ago
- Yeast, a lite and light beamer theme☆18Dec 6, 2020Updated 5 years ago
- ☆29Jun 21, 2023Updated 3 years ago