DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
☆653Nov 24, 2025Updated 8 months ago
Alternatives and similar repositories for DFloat11
Users that are interested in DFloat11 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Aug 26, 2025Updated 11 months ago
- Fused BF16 Huffman GEMV Inference kernel☆22Apr 22, 2026Updated 3 months ago
- [ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models☆3,932Mar 7, 2026Updated 5 months ago
- Code repository for ICLR 2025 paper "LeanQuant: Accurate and Scalable Large Language Model Quantization with Loss-error-aware Grid"☆29Mar 2, 2025Updated last year
- Model Compression Toolbox for Large Language Models and Diffusion Models☆796Aug 14, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆97May 25, 2025Updated last year
- Fork of the official DF11 ComfyUI custom node that aims to support other model architectures, and add support for LoRAs (selected models …☆54Jul 16, 2026Updated 3 weeks ago
- Sparse Inferencing for transformer based LLMs☆219Mar 25, 2026Updated 4 months ago
- [ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-t…☆3,607Jan 17, 2026Updated 6 months ago
- A ComfyUI extention for BAGEL dfloat11 Quantized wrapper (Unified Model for Multimodal Understanding and Generation)☆25May 30, 2025Updated last year
- [NeurIPS 2025] Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation☆608Nov 11, 2025Updated 8 months ago
- The official code that integrates MagCache (Fast Video Generation with Magnitude-Aware Cache) with ComfyUI.☆275Nov 27, 2025Updated 8 months ago
- ☆51May 20, 2025Updated last year
- [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.☆1,024Feb 25, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache☆425Nov 20, 2025Updated 8 months ago
- RAM is all you need☆279Updated this week
- ComfyUI nodes collection: better TAESD previews (including batch previews), improved HyperTile and Deep Shrink nodes☆143Updated this week
- ☆35May 7, 2025Updated last year
- flux distillation and stuff☆123Jun 22, 2025Updated last year
- Official implementation of "Normalized Attention Guidance"☆205Jul 1, 2025Updated last year
- ComfyUI implemtation for NAG☆317Nov 3, 2025Updated 9 months ago
- A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support…☆1,559Updated this week
- SD.Next Quantization Engine☆124Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Work in progress.☆81Nov 25, 2025Updated 8 months ago
- ComfyUI custom node for lightx2v☆90Jun 9, 2026Updated 2 months ago
- Pusa: Thousands Timesteps Video Diffusion Model☆686Feb 13, 2026Updated 5 months ago
- Official implementation of MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglement (ICLR2026)☆300Mar 24, 2026Updated 4 months ago
- ☆87Jun 20, 2025Updated last year
- Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model☆1,365Jun 8, 2025Updated last year
- Fast Matrix Multiplications for Lookup Table-Quantized LLMs☆394Apr 13, 2025Updated last year
- UltraFlux: Data-Model Co-Design for High-quality Native 4K Text-to-Image Generation across Diverse Aspect Ratios☆146Apr 9, 2026Updated 4 months ago
- A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.☆1,243Jul 26, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official implementation of Half-Quadratic Quantization (HQQ)☆953Feb 26, 2026Updated 5 months ago
- ☆127Mar 18, 2026Updated 4 months ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆96May 14, 2026Updated 2 months ago
- A collection of niche / personally useful PyTorch optimizers with modified code.☆28Apr 14, 2026Updated 3 months ago
- The Python Implementation of CRISP: Clustering Multi-Vector Representations for Denoising and Pruning☆27Jul 27, 2025Updated last year
- DMM: Building a Versatile Image Generation Model via Distillation-Based Model Merging☆47Apr 27, 2025Updated last year
- Official implementation for DenseMixer: Improving MoE Post-Training with Precise Router Gradient☆68Aug 3, 2025Updated last year