0xSojalSec / gpu_poorView on GitHub
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
β˜†12Dec 3, 2024Updated last year

Alternatives and similar repositories for gpu_poor

Users that are interested in gpu_poor are comparing it to the libraries listed below

Sorting:

Are these results useful?