DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
☆655Nov 24, 2025Updated 9 months ago
Alternatives and similar repositories for DFloat11
Users that are interested in DFloat11 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Aug 26, 2025Updated last year
- Fused BF16 Huffman GEMV Inference kernel☆22Apr 22, 2026Updated 4 months ago
- [ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models☆3,936Mar 7, 2026Updated 5 months ago
- Code repository for ICLR 2025 paper "LeanQuant: Accurate and Scalable Large Language Model Quantization with Loss-error-aware Grid"☆29Mar 2, 2025Updated last year
- Model Compression Toolbox for Large Language Models and Diffusion Models☆799Aug 14, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆96May 25, 2025Updated last year
- Fork of the official DF11 ComfyUI custom node that aims to support other model architectures, and add support for LoRAs (selected models …☆55Jul 16, 2026Updated last month
- Sparse Inferencing for transformer based LLMs☆221Mar 25, 2026Updated 5 months ago
- [ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-t…☆3,685Jan 17, 2026Updated 7 months ago
- A ComfyUI extention for BAGEL dfloat11 Quantized wrapper (Unified Model for Multimodal Understanding and Generation)☆25May 30, 2025Updated last year
- [NeurIPS 2025] Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation☆608Nov 11, 2025Updated 9 months ago
- The official code that integrates MagCache (Fast Video Generation with Magnitude-Aware Cache) with ComfyUI.☆275Nov 27, 2025Updated 9 months ago
- ☆51May 20, 2025Updated last year
- [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.☆1,042Feb 25, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache☆431Nov 20, 2025Updated 9 months ago
- RAM is all you need☆284Aug 23, 2026Updated last week
- ComfyUI nodes collection: better TAESD previews (including batch previews), improved HyperTile and Deep Shrink nodes☆152Aug 14, 2026Updated 2 weeks ago
- ☆35May 7, 2025Updated last year
- flux distillation and stuff☆124Jun 22, 2025Updated last year
- Official implementation of "Normalized Attention Guidance"☆205Jul 1, 2025Updated last year
- ComfyUI implemtation for NAG☆318Nov 3, 2025Updated 9 months ago
- A SOTA quantization toolkit for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support a…☆1,592Updated this week
- SD.Next Quantization Engine☆128Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Work in progress.☆81Nov 25, 2025Updated 9 months ago
- ComfyUI custom node for lightx2v☆94Jun 9, 2026Updated 2 months ago
- Pusa: Thousands Timesteps Video Diffusion Model☆686Feb 13, 2026Updated 6 months ago
- Official implementation of MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglement (ICLR2026)☆299Mar 24, 2026Updated 5 months ago
- ☆92Jun 20, 2025Updated last year
- Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model☆1,369Jun 8, 2025Updated last year
- Fast Matrix Multiplications for Lookup Table-Quantized LLMs☆394Apr 13, 2025Updated last year
- UltraFlux: Data-Model Co-Design for High-quality Native 4K Text-to-Image Generation across Diverse Aspect Ratios☆147Apr 9, 2026Updated 4 months ago
- A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.☆1,262Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official implementation of Half-Quadratic Quantization (HQQ)☆955Feb 26, 2026Updated 6 months ago
- ☆128Mar 18, 2026Updated 5 months ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆99May 14, 2026Updated 3 months ago
- A collection of niche / personally useful PyTorch optimizers with modified code.☆28Aug 23, 2026Updated last week
- The Python Implementation of CRISP: Clustering Multi-Vector Representations for Denoising and Pruning☆27Jul 27, 2025Updated last year
- DMM: Building a Versatile Image Generation Model via Distillation-Based Model Merging☆47Apr 27, 2025Updated last year
- Official implementation for DenseMixer: Improving MoE Post-Training with Precise Router Gradient☆68Aug 3, 2025Updated last year