[ACM MM2025]: MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization
☆44Aug 13, 2025Updated 10 months ago
Alternatives and similar repositories for MQuant
Users that are interested in MQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…☆52Oct 21, 2023Updated 2 years ago
- The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"☆93Mar 17, 2025Updated last year
- Code repository for ICLR 2025 paper "LeanQuant: Accurate and Scalable Large Language Model Quantization with Loss-error-aware Grid"☆29Mar 2, 2025Updated last year
- [NeurIPS'24]Efficient and accurate memory saving method towards W4A4 large multi-modal models.☆103Jan 3, 2025Updated last year
- iLLaVA: An Image is Worth Fewer Than 1/3 Input Tokens in Large Multimodal Models (ICLR2026)☆23Jun 24, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Pytorch implementation of our paper accepted by CVPR 2022 -- IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Sh…☆37Mar 2, 2022Updated 4 years ago
- Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".☆17Sep 15, 2024Updated last year
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Jun 29, 2026Updated last week
- KV cache compression via sparse coding☆18Oct 26, 2025Updated 8 months ago
- ☆25Nov 22, 2024Updated last year
- ☆14Oct 6, 2023Updated 2 years ago
- ☆22Oct 2, 2024Updated last year
- Instruction Following Eval☆18Jan 16, 2025Updated last year
- A Low-Overhead tool for Floating-Point Exception Detection in NVIDIA GPUs☆15Dec 17, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆21Apr 27, 2026Updated 2 months ago
- [ICML 2025] Fast and Low-Cost Genomic Foundation Models via Outlier Removal.☆19Jun 19, 2025Updated last year
- The wafer-native AI accelerator simulation platform and inference engine.☆56Jan 1, 2026Updated 6 months ago
- official implementation of paper SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training☆44Dec 11, 2024Updated last year
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆221Nov 25, 2025Updated 7 months ago
- ☆20Oct 13, 2024Updated last year
- 2018-2019 大三下学期计算机网络作业合集 (1711342 李纪)☆12Apr 26, 2020Updated 6 years ago
- This repository contains the training code of ParetoQ introduced in our work "ParetoQ Scaling Laws in Extremely Low-bit LLM Quantization"☆129Oct 15, 2025Updated 8 months ago
- [ACL2025 Oral🔥]Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling☆29Nov 11, 2025Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆44Oct 11, 2025Updated 8 months ago
- [CVPR 2024 Highlight & TPAMI 2025] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for…☆110Sep 29, 2025Updated 9 months ago
- ☆13Aug 31, 2023Updated 2 years ago
- Official Repository for Task-Circuit Quantization☆27Jun 1, 2025Updated last year
- Image Quality Assessment Paper Reading☆15Sep 11, 2022Updated 3 years ago
- ☆13May 8, 2023Updated 3 years ago
- MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models☆27Apr 2, 2026Updated 3 months ago
- Quartet II Official Code☆76May 1, 2026Updated 2 months ago
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆15Jul 18, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆34Mar 28, 2025Updated last year
- Source code of paper ''KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing''☆31Oct 24, 2024Updated last year
- ☆17Jun 12, 2026Updated 3 weeks ago
- ☆25Oct 31, 2024Updated last year
- 本人在南开大学学习计算机网络时所写的实验作业☆24Nov 1, 2022Updated 3 years ago
- An efficient distillation method for flow matching models☆27Feb 1, 2026Updated 5 months ago
- [NeurIPS 23' Oral] Emergence of Shape Bias in Convolutional Neural Networks through Activation Sparsity☆27Apr 24, 2024Updated 2 years ago