m0dulo / InferSporeView on GitHub
🌱 A fully independent Large Language Model (LLM) inference engine, built leveraging cuBLAS and cub. 🧩
32Jun 24, 2025Updated 8 months ago

Alternatives and similar repositories for InferSpore

Users that are interested in InferSpore are comparing it to the libraries listed below

Sorting:

Are these results useful?