[ICLR2026] The first W4A4KV4 quantized + 50% sparse LLMs!
☆35Jan 26, 2026Updated 9 months ago
Alternatives and similar repositories for OBR
Users that are interested in OBR are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- offical repo for paper: ROTATED RUNTIME SMOOTH: TRAINING-FREE ACTIVATION SMOOTHER FOR ACCURATE INT4 INFERENCE☆12Oct 1, 2024Updated 2 years ago
- [COLM 2025] DFRot: Achieving Outlier-Free and Massive Activation-Free for Rotated LLMs with Refined Rotation; 知乎：https://zhuanlan.zhihu.c…☆30Mar 5, 2025Updated last year
- Minute-long video generation at 24FPS.☆71Mar 28, 2026Updated 7 months ago
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆228Nov 25, 2025Updated 11 months ago
- [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…☆96Apr 8, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Reduce kernel based on CUTLASS CuTe and TMA.☆12Sep 25, 2025Updated last year
- ☆35Mar 28, 2025Updated last year
- [ICCV2025]Generate one 2K image on single 24GB 3090 GPU!☆88Sep 8, 2025Updated last year
- ☆15Jun 10, 2026Updated 4 months ago
- REAM: Merging Improves Pruning of Experts in LLMs☆29Apr 16, 2026Updated 6 months ago
- [ECCV 2026] MoKus: This repo is the official implementation of "MoKus: Leveraging Cross-Modal Knowledge Transfer for Knowledge-Aware Conc…☆14Jun 19, 2026Updated 4 months ago
- Reflect-RL: Two-Player Online RL Fine-Tuning for LMs☆18Jul 19, 2025Updated last year
- [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.☆189Apr 24, 2026Updated 6 months ago
- ☆127Feb 26, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Mixture-of-Basis-Experts for Compressing MoE-based LLMs☆41Dec 24, 2025Updated 10 months ago
- [ICML 2025] Retraining-Free Merging of Sparse MoE via Hierarchical Clustering☆24Oct 26, 2025Updated last year
- We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…☆23Jan 11, 2026Updated 9 months ago
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆541Nov 26, 2024Updated last year
- [ICLR 2026] Mixing Importance with Diversity: Joint Optimization for KV Cache Compression in Large Vision-Language Models☆32Mar 21, 2026Updated 7 months ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆70Mar 25, 2025Updated last year
- [ICML 2024]: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models☆11May 19, 2024Updated 2 years ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆204Sep 2, 2026Updated 2 months ago
- [ECCV2024] GRA: Detecting Oriented Objects through Group-wise Rotating and Attention☆14Oct 17, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Dec 12, 2024Updated last year
- Unofficial Evaluation for LLaDA2.0-mini-preview with LM-eval☆11Nov 24, 2025Updated 11 months ago
- ☆16Jul 15, 2025Updated last year
- [USENIX ATC'25] GeneralSparse: Bridging the Gap in SpMM for Pruned Large Language Model Inference on GPUs☆14Feb 4, 2026Updated 9 months ago
- ☆15Aug 25, 2025Updated last year
- Official code for HiLS-Attention☆153Aug 13, 2026Updated 2 months ago
- [ICLR'25] ARB-LLM: Alternating Refined Binarizations for Large Language Models☆31Aug 5, 2025Updated last year
- [ICML2025] LoRA fine-tune directly on the INT4 models.☆42Nov 25, 2024Updated last year
- Boosting 4-bit inference kernels with 2:4 Sparsity☆102Sep 4, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A real-time Gaussian Splatting implementation for SLAM systems, building upon the excellent work of MonoGS and Photo-SLAM.☆11Aug 17, 2025Updated last year
- 基于 mirai, Graia 的 QQ 机器人，可执行 Python, Mathematica, C++ 等代码，可以调用 Copilot 补全、Stable Diffusion (NovelAI) 文字转图片☆16Oct 14, 2022Updated 4 years ago
- vision transformer; post-training quantization; model compression; ViT☆13Sep 1, 2026Updated 2 months ago
- langchain实战的各种项目☆12May 22, 2025Updated last year
- [ICML 2026] Elastic Diffusion Transformer: Accelerating SOTA generation models (e.g., Qwen-Image, Hunyuan3d ) through adaptive computatio…☆50Sep 30, 2026Updated last month
- Code implementation of GPTAQ (https://arxiv.org/abs/2504.02692)☆99Jul 28, 2025Updated last year
- Verifiable Process Rewards for Agentic Reasoning☆15Oct 13, 2026Updated 3 weeks ago