MIO: A Foundation Model on Multimodal Tokens
☆34Dec 13, 2024Updated last year
Alternatives and similar repositories for MIO
Users that are interested in MIO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆31Dec 23, 2024Updated last year
- Implementation of the paper "Variable Bitrate Residual Vector Quantization for Audio Coding"☆11Apr 10, 2025Updated last year
- PyTorch implementation of a learnable activation function combining base activation and Random Fourier Features (RFF). This package provi…☆13Feb 2, 2025Updated last year
- ☆12Mar 11, 2025Updated last year
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Aug 29, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 上海交通大学软件学院本科计算机图形 学课程代码仓库☆14Oct 3, 2025Updated 10 months ago
- HEtero-Assists Distillation for Heterogeneous Object Detectors☆10Jul 3, 2023Updated 3 years ago
- Forced alignment decoder for Whisper.☆16Mar 13, 2024Updated 2 years ago
- This is the official code used for WAT 2017 Description Paper titled A Bag of Useful Tricks for Practical Neural Machine Translation: Emb…☆12Oct 24, 2017Updated 8 years ago
- Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'☆101Jul 24, 2024Updated 2 years ago
- ☆55Jan 17, 2025Updated last year
- ☆15Apr 13, 2025Updated last year
- ☆18Mar 2, 2026Updated 5 months ago
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆57Jun 1, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆10May 26, 2022Updated 4 years ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆63Jul 1, 2025Updated last year
- GeneSis is the first generative approach for lexical substitution (EMNLP 2021).☆13Jul 25, 2023Updated 3 years ago
- Project for MIDI to Audio Synthesis☆28Mar 13, 2023Updated 3 years ago
- A real time implementation of the ddsp from google magenta.☆16Nov 8, 2021Updated 4 years ago
- KVAE-Audio: a continuous full-band audio waveform autoencoder☆116Aug 10, 2026Updated last week
- ☆13Apr 30, 2025Updated last year
- semantic tokenizer for speech and music☆20Jul 6, 2025Updated last year
- ☆20Jan 10, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Meanflow and multilingual for F5-TTS model☆16Aug 23, 2025Updated 11 months ago
- A Comprehensive Dataset for Advanced Image Generation and Editing}☆33Oct 2, 2025Updated 10 months ago
- ☆24Nov 16, 2025Updated 9 months ago
- [NeurIPS 2025 Spotlight] A Unified Tokenizer for Visual Generation and Understanding☆530Nov 14, 2025Updated 9 months ago
- [ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,971Jan 8, 2026Updated 7 months ago
- Official implementation of the paper - GD-Retriever: Controllable generative text-music retrieval with diffusion models (Accepted at ISMI…☆19Sep 25, 2025Updated 10 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆157May 30, 2025Updated last year
- GeckoNum Benchmark for T2I Model Eval.☆15Dec 5, 2024Updated last year
- 🔥 [NeurIPS 2024] A Cat Is A Cat (Not A Dog!): Unraveling Information Mix-ups in Text-to-Image Encoders through Causal Analysis and Embed…☆15Jun 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A unified framework for vision-language environments with Gymnasium-compatible interface☆38Mar 17, 2026Updated 5 months ago
- ☆25Jun 19, 2025Updated last year
- ☆65Jan 8, 2025Updated last year
- a Neural Vocoder supporting Ring Attention, Conformer and NSF.☆25Aug 1, 2025Updated last year
- The multi-modal sequence to sequence baseline neural models used in the Grounded SCAN paper.☆16Mar 21, 2021Updated 5 years ago
- The official implementation of the paper "Affective Faces for Goal-Driven Dyadic Communication."☆15Jan 27, 2023Updated 3 years ago
- [ACL2026 oral] Uni-MMMU : A Massive Multi-discipline Multimodal Unified Benchmark☆26Apr 13, 2026Updated 4 months ago