Alternatives and similar repositories for DFloat11

Users that are interested in DFloat11 are comparing it to the libraries listed below

• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆674Updated 9 months ago
• CerebrasResearch / reap
  REAP: Router-weighted Expert Activation Pruning for SMoE compression
  ☆222Updated last month
• z-lab / dflash
  Block Diffusion for Ultra-Fast Speculative Decoding
  ☆459Updated this week
• intel / auto-round
  🎯An accuracy-first, highly efficient quantization toolkit for LLMs, designed to minimize quality degradation across Weight-Only Quantiza…
  ☆839Updated this week
• Cornell-RelaxML / qtip
  ☆163Updated 7 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆326Updated 2 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆394Updated 7 months ago
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆238Updated this week
• nunchaku-ai / deepcompressor
  Model Compression Toolbox for Large Language Models and Diffusion Models
  ☆744Updated 5 months ago
• MoonshotAI / Kimi-Linear
  ☆1,278Updated 2 months ago
• NVlabs / Jet-Nemotron
  ☆725Updated 2 months ago
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆523Updated 11 months ago
• QwenLM / ParScale
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆468Updated 8 months ago
• MoonshotAI / checkpoint-engine
  Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
  ☆902Updated this week
• inclusionAI / dInfer
  dInfer: An Efficient Inference Framework for Diffusion Language Models
  ☆410Updated 3 weeks ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆218Updated 5 months ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆126Updated 2 months ago
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆252Updated last year
• dropbox / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆910Updated last month
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆657Updated 4 months ago
• snu-mllab / KVzip
  [NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)
  ☆196Updated 2 weeks ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆203Updated 2 months ago
• ModelCloud / GPTQModel
  LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU vi…
  ☆1,007Updated this week
• SandAI-org / MagiAttention
  A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
  ☆626Updated this week
• thu-ml / SpargeAttn
  [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
  ☆921Updated last month
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆201Updated last year
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆129Updated 10 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆151Updated last year
• Dao-AILab / sonic-moe
  Accelerating MoE with IO and Tile-aware Optimizations
  ☆563Updated 2 weeks ago
• xuyuzhuang11 / OneBit
  The homepage of OneBit model quantization framework.
  ☆200Updated last year