huggingface / llm-swarm

Manage scalable open LLM inference endpoints in Slurm clusters
252Updated 7 months ago

Alternatives and similar repositories for llm-swarm:

Users that are interested in llm-swarm are comparing it to the libraries listed below