microsoft / glinthawk

An LLM inference engine, written in C++
12Updated 2 months ago

Alternatives and similar repositories for glinthawk:

Users that are interested in glinthawk are comparing it to the libraries listed below