WackyGem / Nicol

Nicol is an open-source web service, developed using the Kotlin programming language, that enables streaming Server Stream Events and supports CPU inference for the port of llama2 model.
9Updated 11 months ago

Related projects

Alternatives and complementary repositories for Nicol