WackyGem / Nicol

Nicol is an open-source web service, developed using the Kotlin programming language, that enables streaming Server Stream Events and supports CPU inference for the port of llama2 model.
10Updated last year

Alternatives and similar repositories for Nicol:

Users that are interested in Nicol are comparing it to the libraries listed below