Alternatives and similar repositories for DFloat11

Users that are interested in DFloat11 are comparing it to the libraries listed below

• intel / auto-round
  Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU.
  ☆701Updated this week
• nunchaku-tech / deepcompressor
  Model Compression Toolbox for Large Language Models and Diffusion Models
  ☆692Updated 2 months ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆663Updated 6 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆390Updated 4 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆308Updated 5 months ago
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆187Updated last week
• Cornell-RelaxML / qtip
  ☆152Updated 4 months ago
• MoonshotAI / Kimi-Linear
  ☆1,073Updated last week
• ModelCloud / GPTQModel
  LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU vi…
  ☆860Updated last week
• NVlabs / Jet-Nemotron
  ☆700Updated 3 weeks ago
• QwenLM / ParScale
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆450Updated 5 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆201Updated 3 months ago
• thu-ml / SpargeAttn
  [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
  ☆765Updated this week
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆499Updated 9 months ago
• MoonshotAI / checkpoint-engine
  Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
  ☆820Updated this week
• SandAI-org / MagiAttention
  A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
  ☆550Updated this week
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆249Updated 9 months ago
• xuyuzhuang11 / OneBit
  The homepage of OneBit model quantization framework.
  ☆194Updated 9 months ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆125Updated 7 months ago
• vipshop / cache-dit
  A Unified and Flexible Inference Engine with Hybrid Cache Acceleration and Parallelism for 🤗Diffusers.
  ☆542Updated this week
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,354Updated 3 months ago
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆597Updated last month
• PrimeIntellect-ai / OpenDiloco
  OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
  ☆546Updated 10 months ago
• DreamLM / Dream
  Dream 7B, a large diffusion language model
  ☆1,054Updated last month
• chengzeyi / ParaAttention
  https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching
  ☆385Updated 4 months ago
• sayakpaul / diffusers-torchao
  End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8 training).
  ☆380Updated 5 months ago
• deepreinforce-ai / CUDA-L1
  CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
  ☆244Updated last week
• dropbox / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆889Updated 2 weeks ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆376Updated 7 months ago
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆680Updated this week