antonellof / frinkView on GitHub
Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.
☆65Nov 6, 2026Updated this week

Alternatives and similar repositories for frink

Users that are interested in frink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?