☆18Apr 7, 2025Updated last year
Alternatives and similar repositories for MoEQuant
Users that are interested in MoEQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2025] MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design☆31Jul 4, 2025Updated last year
- [ICLR 2025, IEEE TPAMI 2026] Mixture Compressor & MC#☆79Feb 12, 2025Updated last year
- [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…☆96Apr 8, 2025Updated last year
- ☆42Mar 28, 2024Updated 2 years ago
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"☆97Mar 17, 2025Updated last year
- The official implement of "Routing Experts: Learning to Route Dynamic Experts in Existing Multi-modal Large Language Models"☆17Mar 24, 2025Updated last year
- Code repo for efficient quantized MoE inference with mixture of low-rank compensators☆39Apr 14, 2025Updated last year
- The official implementation of the ICML 2023 paper OFQ-ViT☆39Oct 3, 2023Updated 3 years ago
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆32Feb 17, 2025Updated last year
- Implementation of NM sparsity recipe presented in the paper "Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers".☆11Feb 5, 2024Updated 2 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆31Mar 12, 2024Updated 2 years ago
- ☆158Jun 22, 2023Updated 3 years ago
- Code for data-aware compression of DeepSeek models☆75Dec 11, 2025Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Pytorch code for paper QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models☆25Sep 27, 2023Updated 3 years ago
- ☆35Mar 26, 2026Updated 6 months ago
- Implementation of Microscaling data formats in SystemVerilog.☆34Jul 6, 2025Updated last year
- Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…☆52Oct 21, 2023Updated 2 years ago
- Official Code of The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks[ICML2022]☆16Sep 20, 2022Updated 4 years ago
- [CVPR 2026] This is the official PyTorch implementation of "MoDES: Accelerating Mixture-of-Experts Multimodal Large Language Models via D…☆34Mar 16, 2026Updated 6 months ago
- This repository contains code for the MicroAdam paper.☆21Dec 14, 2024Updated last year
- The official implementation of BiViT: Extremely Compressed Binary Vision Transformers☆16Jun 18, 2023Updated 3 years ago
- PyTorch code for full quantization of DNN using BCGD☆14Jul 24, 2019Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆51Apr 9, 2024Updated 2 years ago
- source code of the paper: Robust Quantization: One Model to Rule Them All☆42Mar 24, 2023Updated 3 years ago
- An individual project related to denoising for event camera☆21Feb 25, 2024Updated 2 years ago
- 一个小游戏☆14Aug 17, 2022Updated 4 years ago
- ☆126Feb 26, 2026Updated 7 months ago
- ☆64Jul 21, 2024Updated 2 years ago
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆434Feb 14, 2025Updated last year
- Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent☆16Sep 8, 2022Updated 4 years ago
- A demo of the Mito Streamlit Spreadsheet☆18Aug 3, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code needed to reproduce results from my ICLR 2019 paper on fixed-point quantization of the backprop algorithm.☆10Jan 24, 2019Updated 7 years ago
- ☆11Dec 8, 2022Updated 3 years ago
- [ICLR'25] R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference☆21Apr 28, 2025Updated last year
- KimiaPath24: Dataset for retrieval and classification in digital pathology☆13Jun 4, 2017Updated 9 years ago
- Optimizing Deep Convolutional Neural Network with Ternarized Weights and High Accuracy☆16Jan 27, 2019Updated 7 years ago
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated last year
- [ICLR 2025] Official implementation of paper "Dynamic Low-Rank Sparse Adaptation for Large Language Models".☆25Mar 16, 2025Updated last year