jindongli-Ai / LLM-Discrete-Tokenization-SurveyLinks
The official GitHub page for the survey paper "Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey". And this paper is under review.
☆65Updated 2 months ago
Alternatives and similar repositories for LLM-Discrete-Tokenization-Survey
Users that are interested in LLM-Discrete-Tokenization-Survey are comparing it to the libraries listed below
Sorting:
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆100Updated 4 months ago
- Keras implement of Finite Scalar Quantization☆83Updated 2 years ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆39Updated last year
- LMM solved catastrophic forgetting, AAAI2025☆44Updated 6 months ago
- ☆61Updated 5 months ago
- toy reproduction of Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts☆24Updated last year
- [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501☆57Updated last year
- Explore how to get a VQ-VAE models efficiently!☆60Updated 3 months ago
- [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning☆15Updated last year
- Mixture of Attention Heads☆51Updated 3 years ago
- A project for tri-modal LLM benchmarking and instruction tuning.☆48Updated 7 months ago
- ☆120Updated last year
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆63Updated 2 months ago
- [CVPR] MergeVQ: A Unified Framework for Visual Generation and Representation with Token Merging and Quantization☆44Updated 3 months ago
- ☆148Updated last year
- ☆139Updated last year
- ☆197Updated last year
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆133Updated 6 months ago
- [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)☆126Updated last year
- ☆67Updated last month
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated last year
- Official repository for paper "DeepCritic: Deliberate Critique with Large Language Models"☆40Updated 4 months ago
- A unified framework for controllable caption generation across images, videos, and audio. Supports multi-modal inputs and customizable ca…☆52Updated 3 months ago
- ☆30Updated 6 months ago
- Latest Advances on Reasoning of Multimodal Large Language Models (Multimodal R1 \ Visual R1) ) 🍓☆34Updated 6 months ago
- ☆86Updated 5 months ago
- ☆30Updated 3 months ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆157Updated 4 months ago
- Code for paper "Patch-Level Training for Large Language Models"☆89Updated 11 months ago
- [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆94Updated 2 months ago