[TPAMI 2026] Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey.
☆85Mar 25, 2026Updated 6 months ago
Alternatives and similar repositories for LLM-Discrete-Tokenization-Survey
Users that are interested in LLM-Discrete-Tokenization-Survey are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Nov 16, 2025Updated 10 months ago
- The demo page for ALMTokenizer☆59Apr 14, 2025Updated last year
- Meanflow and multilingual for F5-TTS model☆16Aug 23, 2025Updated last year
- Explore how to get a VQ-VAE models efficiently!☆69Jul 24, 2025Updated last year
- ☆112Oct 16, 2025Updated 11 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This repository contains the code for our paper "Augmenting Black-box LLMs with Medical Textbooks for Clinical Question Answering" [EMNLP…☆14Oct 8, 2024Updated 2 years ago
- Implementation of the paper "Variable Bitrate Residual Vector Quantization for Audio Coding"☆11Apr 10, 2025Updated last year
- [ACL 2026 Main] Training, inference, and testing of the SAC speech codec model.☆111Nov 1, 2025Updated 11 months ago
- [CVPRW 2025] UniToken is an auto-regressive generation model that combines discrete and continuous representations to process visual inpu…☆106Apr 23, 2025Updated last year
- T5Voice is a lightweight PyTorch implementation of T5-based text-to-speech synthesis, supporting both streaming and non-streaming speech …☆28Nov 7, 2025Updated 11 months ago
- ☆52Apr 27, 2026Updated 5 months ago
- The open source code of ALMTokenizer2: Towards Low bit-rate and Semantic-rich Audio Tokenizer with Flow-based Scalar Diffusion Transforme…☆46Sep 5, 2025Updated last year
- ☆36Apr 9, 2025Updated last year
- ☆12Mar 11, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Qwen2.5-Omni fine-tuned on MNV-17 dataset for nonverbal vocalization recognition☆32Nov 13, 2025Updated 10 months ago
- A lightweight audio codec based on a single quantizer☆72Aug 15, 2025Updated last year
- ☆118Jan 11, 2026Updated 9 months ago
- A simple implementation for improving CosyVoice2 by GRPO method☆39May 5, 2026Updated 5 months ago
- [ICLR 2026] An official implementation of "STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence"☆45Apr 19, 2026Updated 5 months ago
- [AAAI 2025] Official Implementation of "HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting"☆19Feb 17, 2025Updated last year
- [NeurIPS 2025 Spotlight] A Unified Tokenizer for Visual Generation and Understanding☆535Nov 14, 2025Updated 10 months ago
- ☆26Jun 19, 2025Updated last year
- Language Modeling for Urban Mobility: A Data-Centric Review and Guidelines☆22Jan 14, 2026Updated 8 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official repo for DisCoder: High-Fidelity Music Vocoder using Neural Audio Codecs presented at ICASSP 2025☆48Feb 24, 2025Updated last year
- A 1.6B causal Transformer audio tokenizer with streaming, variable bitrates, and semantic alignment across speech, sound, and music☆258Jun 16, 2026Updated 3 months ago
- ☆52Apr 20, 2026Updated 5 months ago
- 5Hz Deep-Compression Speech VAE for AR-Diffusion and CALMs☆57Nov 19, 2025Updated 10 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆160May 30, 2025Updated last year
- Awesome Unified Multimodal Models☆1,323Mar 24, 2026Updated 6 months ago
- Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"☆12Jul 25, 2024Updated 2 years ago
- [ICCV 2025] SimVQ: Addressing Representation Collapse in Vector Quantized Models with One Linear Layer☆333Dec 29, 2024Updated last year
- ☆170Nov 20, 2025Updated 10 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆77Dec 3, 2025Updated 10 months ago
- a guide to grapheme-to-phoneme conversion and phoneme list for ace singing voice synthesis engine☆44Jan 17, 2025Updated last year
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆130Jun 21, 2026Updated 3 months ago
- ☆17Jan 1, 2024Updated 2 years ago
- ☆27Jan 27, 2026Updated 8 months ago
- [AAAI 2026 & ACL 2026] The official implementation of the DIFFA series for dLLM-based large audio language model☆84Apr 7, 2026Updated 6 months ago
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆196Jan 25, 2026Updated 8 months ago