microsoft / best-route-llm
View external linksLinks

Efficient LLM query routing via multi-sampling. BEST-Route selects both model and number of responses based on query difficulty, cutting costs by up to 60% with <1% performance drop. From the paper//arxiv.org/abs/2506.22716
42Aug 6, 2025Updated 6 months ago

Alternatives and similar repositories for best-route-llm

Users that are interested in best-route-llm are comparing it to the libraries listed below

Sorting:

Are these results useful?