huggingface / llm-swarm

Manage scalable open LLM inference endpoints in Slurm clusters
253Updated 8 months ago

Alternatives and similar repositories for llm-swarm:

Users that are interested in llm-swarm are comparing it to the libraries listed below