turboderp-org / exllamav2Links

A fast inference library for running LLMs locally on modern consumer-class GPUs
4,187Updated 2 weeks ago

Alternatives and similar repositories for exllamav2

Users that are interested in exllamav2 are comparing it to the libraries listed below

Sorting: