YellowRoseCx / koboldcpp-rocm

AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
506Updated this week

Alternatives and similar repositories for koboldcpp-rocm:

Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below