JohnMing143 / llm-api-speedtesterView on GitHub
这是一个部署在 Cloudflare Worker 上的小工具,用于测试大语言模型 (LLM) API 的调用速度和性能。它可以测量不同输入和输出 Token 组合下的吞吐量 (tokens/sec) 和首个 Token 的平均响应延迟。
24May 18, 2025Updated 10 months ago

Alternatives and similar repositories for llm-api-speedtester

Users that are interested in llm-api-speedtester are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?