VectorInstitute / vector-inference

Efficient LLM inference on Slurm clusters using vLLM.
43Updated this week

Alternatives and similar repositories for vector-inference:

Users that are interested in vector-inference are comparing it to the libraries listed below