jindongli-Ai / LLM-Discrete-Tokenization-SurveyLinks
The official GitHub page for the survey paper "Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey". And this paper is under review.
☆63Updated last month
Alternatives and similar repositories for LLM-Discrete-Tokenization-Survey
Users that are interested in LLM-Discrete-Tokenization-Survey are comparing it to the libraries listed below
Sorting:
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆91Updated 3 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆39Updated 11 months ago
- Keras implement of Finite Scalar Quantization☆82Updated last year
- LMM solved catastrophic forgetting, AAAI2025☆44Updated 5 months ago
- A unified framework for controllable caption generation across images, videos, and audio. Supports multi-modal inputs and customizable ca…☆50Updated last month
- ☆116Updated last year
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…☆98Updated 2 months ago
- ☆27Updated 2 months ago
- ☆59Updated 4 months ago
- [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501☆56Updated last year
- A project for tri-modal LLM benchmarking and instruction tuning.☆47Updated 5 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆131Updated 5 months ago
- [CVPR] MergeVQ: A Unified Framework for Visual Generation and Representation with Token Merging and Quantization☆42Updated last month
- Official repository for paper "DeepCritic: Deliberate Critique with Large Language Models"☆35Updated 2 months ago
- ☆137Updated last year
- Code for paper "Patch-Level Training for Large Language Models"☆87Updated 10 months ago
- Latest Advances on Reasoning of Multimodal Large Language Models (Multimodal R1 \ Visual R1) ) 🍓☆34Updated 5 months ago
- ☆197Updated last year
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆61Updated last month
- ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…☆46Updated 3 months ago
- The most open diffusion language model for code generation — releasing pretraining, evaluation, inference, and checkpoints.☆247Updated this week
- [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆90Updated last month
- Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas☆74Updated last week
- This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels☆59Updated last week
- ☆148Updated last year
- ☆30Updated 5 months ago
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆56Updated 4 months ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆154Updated 2 months ago
- ☆35Updated 3 weeks ago
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.☆448Updated this week