MIO: A Foundation Model on Multimodal Tokens
☆34Dec 13, 2024Updated last year
Alternatives and similar repositories for MIO
Users that are interested in MIO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Mar 11, 2025Updated last year
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Aug 29, 2023Updated 3 years ago
- Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'☆101Jul 24, 2024Updated 2 years ago
- ☆55Jan 17, 2025Updated last year
- Lyra V2 (SoundStream) running in the browser☆19Sep 20, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆15Apr 13, 2025Updated last year
- ☆18Mar 2, 2026Updated 6 months ago
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆57Jun 1, 2025Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆63Jul 1, 2025Updated last year
- Project for MIDI to Audio Synthesis☆29Mar 13, 2023Updated 3 years ago
- A real time implementation of the ddsp from google magenta.☆16Nov 8, 2021Updated 4 years ago
- KVAE-Audio: a continuous full-band audio waveform autoencoder☆122Aug 10, 2026Updated 3 weeks ago
- semantic tokenizer for speech and music☆20Jul 6, 2025Updated last year
- ☆13Apr 30, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆20Jan 10, 2025Updated last year
- Meanflow and multilingual for F5-TTS model☆16Aug 23, 2025Updated last year
- A Comprehensive Dataset for Advanced Image Generation and Editing}☆32Oct 2, 2025Updated 11 months ago
- ☆24Nov 16, 2025Updated 9 months ago
- Speech Resynthesis and Language Modeling☆27Jun 11, 2025Updated last year
- [NeurIPS 2025 Spotlight] A Unified Tokenizer for Visual Generation and Understanding☆530Nov 14, 2025Updated 9 months ago
- [ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,976Jan 8, 2026Updated 7 months ago
- Official implementation of the paper - GD-Retriever: Controllable generative text-music retrieval with diffusion models (Accepted at ISMI…☆19Sep 25, 2025Updated 11 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆158May 30, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A unified framework for vision-language environments with Gymnasium-compatible interface☆38Mar 17, 2026Updated 5 months ago
- ☆25Jun 19, 2025Updated last year
- a Neural Vocoder supporting Ring Attention, Conformer and NSF.☆25Aug 1, 2025Updated last year
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆49Jan 19, 2026Updated 7 months ago
- [ACL2026 oral] Uni-MMMU : A Massive Multi-discipline Multimodal Unified Benchmark☆27Apr 13, 2026Updated 4 months ago
- Official repository of Myna: Masking-Based Contrastive Learning of Musical Representations☆17Mar 31, 2025Updated last year
- My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"☆13Nov 11, 2024Updated last year
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆314Oct 12, 2025Updated 10 months ago
- A collection of pre-trained audio models, in PyTorch.☆116Jan 27, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A neural speech codec based on discrete WavLM representations☆26Aug 28, 2024Updated 2 years ago
- Official Pytorch Implementation of Our CVPR2023 Paper: "Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image…☆68Jul 21, 2023Updated 3 years ago
- iFSQ & LlamaGen-REPA☆106Jan 27, 2026Updated 7 months ago
- [EMNLP 2026' Main] HoliTok:A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding☆49Jun 8, 2026Updated 2 months ago
- ☆24Apr 2, 2026Updated 5 months ago
- ☆18Sep 19, 2024Updated last year
- ☆13Aug 14, 2026Updated 3 weeks ago