ankan-ban / llama_cu_awqLinks

llama INT4 cuda inference with AWQ
54Updated 4 months ago

Alternatives and similar repositories for llama_cu_awq

Users that are interested in llama_cu_awq are comparing it to the libraries listed below

Sorting: