m0dulo / InferSpore

🌱 A fully independent Large Language Model (LLM) inference engine, built leveraging cuBLAS and cub. 🧩
19Updated last week

Alternatives and similar repositories for InferSpore

Users that are interested in InferSpore are comparing it to the libraries listed below

Sorting: