ruikangliu / FlatQuant

Official PyTorch implementation of FlatQuant: Flatness Matters for LLM Quantization
108Updated last month

Alternatives and similar repositories for FlatQuant:

Users that are interested in FlatQuant are comparing it to the libraries listed below