A survey of modern quantization formats (e.g., MXFP8, NVFP4) and inference optimization tools (e.g., TorchAO, GemLite), illustrated through the example of Llama-3.1 inference.
☆12Nov 11, 2025Updated last year
Alternatives and similar repositories for Survey-of-Quantization-Formats
Users that are interested in Survey-of-Quantization-Formats are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GPU kernel benchmarking☆52Oct 10, 2026Updated last month
- ☆15Mar 21, 2024Updated 2 years ago
- Reference implementation of generalized orders of magnitude, as proposed in "Generalized Orders of Magnitude for Scalable, Parallel, High…☆11Dec 6, 2025Updated 11 months ago
- Python library for DeepAffects API☆10Jul 5, 2023Updated 3 years ago
- GPU Performance and Cost Cheatsheet☆16Jul 13, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Jul 29, 2026Updated 3 months ago
- An open-sourced PyTorch library for developing energy efficient multiplication-less models and applications.☆14Feb 3, 2025Updated last year
- ☆51Aug 17, 2026Updated 3 months ago
- A document describing purity detection in EVM opcode☆16Mar 28, 2022Updated 4 years ago
- Two case studies: megakernels roughly on par with CUDA Graphs + PDL. Code and baselines for further research.☆12Nov 6, 2026Updated last week
- A Low-Overhead tool for Floating-Point Exception Detection in NVIDIA GPUs☆16Dec 17, 2024Updated last year
- Template for integrating stripe into your FastAPI application 💸☆14May 27, 2024Updated 2 years ago
- associative floating point addition☆21Apr 30, 2024Updated 2 years ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- RL post-training with your Apple-silicon Macs as the rollout fleet: Mac workers generate experience, GPUs learn, synced over Cloudflare R…☆12Aug 11, 2026Updated 3 months ago
- ☆11Oct 27, 2022Updated 4 years ago
- Open source reference implementation for a simple, metamodel-based Hyperliquid portfolio rebalancer☆12Dec 10, 2025Updated 11 months ago
- Hilbert-style formal proofs for mathematics☆12Jun 25, 2018Updated 8 years ago
- Learn about PTX instructions ldmatrix and stmatrix☆12Sep 5, 2025Updated last year
- ☆11Nov 20, 2024Updated last year
- wolfbench.ai · Wolfram Ravenwolf's Five-Metric Framework · based on Terminal-Bench 2.0☆12Apr 29, 2026Updated 6 months ago
- Vivado HLS study notes, courses, documents.☆13Dec 7, 2019Updated 6 years ago
- shepherd is a framework to build content moderation systems.☆13Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Oct 24, 2018Updated 8 years ago
- ☆12Jul 8, 2026Updated 4 months ago
- Evaluation scripts for the Open TTS Leaderboard: https://huggingface.co/spaces/hf-audio/open_tts_leaderboard☆15Updated this week
- ☆18Nov 20, 2022Updated 3 years ago
- A comprehensive benchmark to evaluate and improve the fundamental numerical reasoning abilities of large language models using diverse sy…☆30Jun 21, 2025Updated last year
- Execution-state orchestration layer for FlashRT: model-runtime adoption, stage-DAG scheduling, RTC action chunks, and capsule state contr…☆13Sep 7, 2026Updated 2 months ago
- Some implementations of differentiable 3D mesh renderers using PyTorch with examples☆10Mar 21, 2024Updated 2 years ago
- Official Repository for "The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm" (ICLR 2026)☆13Apr 16, 2026Updated 7 months ago
- ML framework featuring compile time checks and accelerated by a JIT compiler.☆10Mar 19, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 海康威视Python封装☆29Jan 5, 2024Updated 2 years ago
- [ICCAD'22 TinyML Contest] Efficient Heart Stroke Detection on Low-cost Microcontrollers☆15Jan 12, 2023Updated 3 years ago
- Get Moving with Pynq on Alveo U50☆15Jul 13, 2020Updated 6 years ago
- GPU CI/CD tool that tests CUDA kernels across multiple GPUs in parallel - Part of RightNow☆15Jan 25, 2026Updated 9 months ago
- ☆11Aug 21, 2025Updated last year
- Code & data for "Protein Language Models Expose Viral Mimicry and Immune Escape"☆13Sep 1, 2025Updated last year
- Header-only C++20 benchmarking for CPU and CUDA: cross-platform hardware counters, adaptive sampling that runs until results converge, an…☆21Updated this week
Are these results useful?