A survey of modern quantization formats (e.g., MXFP8, NVFP4) and inference optimization tools (e.g., TorchAO, GemLite), illustrated through the example of Llama-3.1 inference.
☆12Nov 11, 2025Updated 11 months ago
Alternatives and similar repositories for Survey-of-Quantization-Formats
Users that are interested in Survey-of-Quantization-Formats are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GPU kernel benchmarking☆51Oct 10, 2026Updated 2 weeks ago
- ☆15Mar 21, 2024Updated 2 years ago
- Python library for DeepAffects API☆10Jul 5, 2023Updated 3 years ago
- GPU Performance and Cost Cheatsheet☆16Jul 13, 2025Updated last year
- ☆11Jul 29, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Template for integrating stripe into your FastAPI application 💸☆14May 27, 2024Updated 2 years ago
- ☆51Aug 17, 2026Updated 2 months ago
- An open-sourced PyTorch library for developing energy efficient multiplication-less models and applications.☆14Feb 3, 2025Updated last year
- A document describing purity detection in EVM opcode☆16Mar 28, 2022Updated 4 years ago
- A Low-Overhead tool for Floating-Point Exception Detection in NVIDIA GPUs☆16Dec 17, 2024Updated last year
- associative floating point addition☆22Apr 30, 2024Updated 2 years ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- RL post-training with your Apple-silicon Macs as the rollout fleet: Mac workers generate experience, GPUs learn, synced over Cloudflare R…☆12Aug 11, 2026Updated 2 months ago
- Hilbert-style formal proofs for mathematics☆12Jun 25, 2018Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Oct 27, 2022Updated 4 years ago
- Learn about PTX instructions ldmatrix and stmatrix☆12Sep 5, 2025Updated last year
- ☆11Nov 20, 2024Updated last year
- A vLLM fork that adds support for steering, an activation capture consumer plugin system, dynamic activation-conditioned steering, and ac…☆26Oct 21, 2026Updated last week
- A comprehensive benchmark to evaluate and improve the fundamental numerical reasoning abilities of large language models using diverse sy…☆30Jun 21, 2025Updated last year
- GPU CI/CD tool that tests CUDA kernels across multiple GPUs in parallel - Part of RightNow☆15Jan 25, 2026Updated 9 months ago
- Vivado HLS study notes, courses, documents.☆13Dec 7, 2019Updated 6 years ago
- shepherd is a framework to build content moderation systems.☆13Updated this week
- Low Latency inference for sliding window LSTMs☆17Aug 31, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Oct 24, 2018Updated 8 years ago
- Get Moving with Pynq on Alveo U50☆15Jul 13, 2020Updated 6 years ago
- ☆18Nov 20, 2022Updated 3 years ago
- 海康威视Python封装☆29Jan 5, 2024Updated 2 years ago
- Some implementations of differentiable 3D mesh renderers using PyTorch with examples☆10Mar 21, 2024Updated 2 years ago
- The simplest repo for scGPT inference, finetuning and training.☆18Oct 12, 2026Updated 2 weeks ago
- ☆13Nov 9, 2018Updated 7 years ago
- toolpa is an AI-native instrument framework for the browser.☆19May 17, 2026Updated 5 months ago
- [ICCAD'22 TinyML Contest] Efficient Heart Stroke Detection on Low-cost Microcontrollers☆15Jan 12, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆11Aug 21, 2025Updated last year
- NVIDIA Cosmos Evaluator is an automated evaluation & grading system for synthetic video output generated by Cosmos models☆54Oct 20, 2026Updated last week
- Code & data for "Protein Language Models Expose Viral Mimicry and Immune Escape"☆13Sep 1, 2025Updated last year
- Header-only C++20 benchmarking for CPU and CUDA: cross-platform hardware counters, adaptive sampling that runs until results converge, an…☆21Updated this week
- ☆17May 18, 2026Updated 5 months ago
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 8 months ago
- ☆20Mar 16, 2022Updated 4 years ago