CharlesMod / quantizeHFmodelLinks

Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
38Updated last year

Alternatives and similar repositories for quantizeHFmodel

Users that are interested in quantizeHFmodel are comparing it to the libraries listed below

Sorting: