MIO: A Foundation Model on Multimodal Tokens
☆34Dec 13, 2024Updated last year
Alternatives and similar repositories for MIO
Users that are interested in MIO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆31Dec 23, 2024Updated last year
- Implementation of the paper "Variable Bitrate Residual Vector Quantization for Audio Coding"☆11Apr 10, 2025Updated last year
- ☆12Mar 11, 2025Updated last year
- Official implementation of the paper - GD-Retriever: Controllable generative text-music retrieval with diffusion models (Accepted at ISMI…☆19Sep 25, 2025Updated 9 months ago
- a Neural Vocoder supporting Ring Attention, Conformer and NSF.☆25Aug 1, 2025Updated 11 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Official repository of Myna: Masking-Based Contrastive Learning of Musical Representations☆17Mar 31, 2025Updated last year
- ☆10Nov 9, 2022Updated 3 years ago
- ☆18Apr 19, 2024Updated 2 years ago
- Dataset collection and training code for "Ask Your Humans: Using Human Instructions to Improve Generalization in Reinforcement Learning"☆11Apr 8, 2025Updated last year
- Lyra V2 (SoundStream) running in the browser☆19Sep 20, 2023Updated 2 years ago
- A real time implementation of the ddsp from google magenta.☆16Nov 8, 2021Updated 4 years ago
- Project for MIDI to Audio Synthesis☆27Mar 13, 2023Updated 3 years ago
- GeneSis is the first generative approach for lexical substitution (EMNLP 2021).☆13Jul 25, 2023Updated 2 years ago
- This repository is for the paper Incorporating External POS Tagger for Punctuation Restoration. Proc. Interspeech 2021, 1987-1991, doi: 1…☆11May 24, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Speech Resynthesis and Language Modeling☆27Jun 11, 2025Updated last year
- My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"☆14Nov 11, 2024Updated last year
- The multi-modal sequence to sequence baseline neural models used in the Grounded SCAN paper.☆16Mar 21, 2021Updated 5 years ago
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆49Jan 19, 2026Updated 5 months ago
- applying audio FX with text descriptors☆35Nov 12, 2025Updated 7 months ago
- A TTS Trained on Universal Audio.☆41Jun 6, 2025Updated last year
- Code base for the EMNLP 2021 paper, "Multi-granularity Textual Adversarial Attack with Behavior Cloning".☆13Apr 18, 2022Updated 4 years ago
- [ICLR'25] Official repository for "AVHBench: A Cross-Modal Hallucination Evaluation for Audio-Visual Large Language Models"☆25Mar 8, 2026Updated 3 months ago
- A collection of pre-trained audio models, in PyTorch.☆116Jan 27, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated last year
- A PyTorch implementation of NormSoftmax based on BMVC 2019 paper "Classification is a Strong Baseline for Deep Metric Learning"☆10Mar 15, 2020Updated 6 years ago
- ☆15Aug 4, 2024Updated last year
- ☆21Mar 3, 2026Updated 4 months ago
- Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"☆33Oct 12, 2024Updated last year
- ☆36Feb 5, 2024Updated 2 years ago
- ☆55Jul 16, 2025Updated 11 months ago
- Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'☆101Jul 24, 2024Updated last year
- The assignments from Stanford Natural Language Processing Course on Coursera, started Jan 2016, Finished Jan 2016☆13Jan 28, 2016Updated 10 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [NeurIPS 2025] The official code for "IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation"☆121Jun 9, 2026Updated 3 weeks ago
- ☆25Nov 25, 2025Updated 7 months ago
- An efficient distillation method for flow matching models☆27Feb 1, 2026Updated 5 months ago
- Official Implementation of EnCLAP (ICASSP 2024)☆96Jun 2, 2024Updated 2 years ago
- Finetuning Stable Diffusion from Diffusers☆11Mar 11, 2024Updated 2 years ago
- My vocoder experiments☆31Jul 26, 2025Updated 11 months ago
- ☆41May 15, 2023Updated 3 years ago