m0dulo / InferSporeView on GitHub
🌱 A fully independent Large Language Model (LLM) inference engine, built leveraging cuBLAS and cub. 🧩
32Jun 24, 2025Updated 9 months ago

Alternatives and similar repositories for InferSpore

Users that are interested in InferSpore are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?