VectorInstitute / vector-inferenceLinks

Efficient LLM inference on Slurm clusters using vLLM.
65Updated last week

Alternatives and similar repositories for vector-inference

Users that are interested in vector-inference are comparing it to the libraries listed below

Sorting: