CharlesMod / quantizeHFmodel

Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
38Updated last year

Alternatives and similar repositories for quantizeHFmodel:

Users that are interested in quantizeHFmodel are comparing it to the libraries listed below