VectorInstitute / vector-inferenceLinks

Efficient LLM inference on Slurm clusters using vLLM.
64Updated this week

Alternatives and similar repositories for vector-inference

Users that are interested in vector-inference are comparing it to the libraries listed below

Sorting: