m0dulo / InferSpore

🌱 A fully independent Large Language Model (LLM) inference engine, built leveraging cuBLAS and cub. 🧩
17Updated this week

Alternatives and similar repositories for InferSpore:

Users that are interested in InferSpore are comparing it to the libraries listed below