epolewski / EricLLM

A fast batching API to serve LLM models
180Updated 9 months ago

Alternatives and similar repositories for EricLLM:

Users that are interested in EricLLM are comparing it to the libraries listed below