antonellof / frinkView on GitHub
Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.
☆62Sep 23, 2026Updated 3 weeks ago

Alternatives and similar repositories for frink

Users that are interested in frink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?