JohnMing143 / llm-api-speedtesterLinks
这是一个部署在 Cloudflare Worker 上的小工具,用于测试大语言模型 (LLM) API 的调用速度和性能。它可以测量不同输入和输出 Token 组合下的吞吐量 (tokens/sec) 和首个 Token 的平均响应延迟。
☆23Updated 6 months ago
Alternatives and similar repositories for llm-api-speedtester
Users that are interested in llm-api-speedtester are comparing it to the libraries listed below
Sorting:
- OpenAI compatible /chat/completions endpoint for fal.ai☆49Updated 5 months ago
- only one claude code proxy☆169Updated last week
- API 代理服务☆86Updated last month
- Unified management of projects with large model APIs, unified conversion to OpenAI format, calling multiple backend services, OpenAI, Ant…☆136Updated 2 months ago
- This is a web application designed to browse, filter, sort, and manage free models available on OpenRouter. It allows users to easily sel…☆89Updated 2 months ago
- ⭐️ A cross-platform CLI All-in-One assistant tool for Claude Code, Codex & Gemini CLI.☆68Updated this week
- Pure Front-End LLM API Testing Tool☆76Updated 7 months ago
- 一个跑在 Cloudflare Workers 上的图片生成 API 代理,帮你智能优化提示词、代理图片,安全又好用!🚀☆83Updated 6 months ago
- ☆49Updated 6 months ago
- ZtoApi 是一个高性能的 OpenAI 兼容 API 代理服务器,专为 Z.ai 的 GLM-4.5 和 GLM-4.5V 模型设计。使用 Deno 原生 HTTP API 实现,支持完整的流式和非流式响应,提供实时监控 Dashboard,让你能够无缝地将 Z.ai …☆117Updated 2 months ago
- Cloudflare Worker SSL Certificate Application Agent☆65Updated last month
- 借助cloudflare tunnel实现在容器平台的frp内网穿透☆47Updated 7 months ago
- This is a simple Cloudflare Worker that transform Cohere API to OpenAI API, easily deployable to Cloudflare Workers.☆44Updated 8 months ago
- A list of projects that enables you to use GPT-3.5 for free☆40Updated last year
- A MCP server for automated website deployment to 1Panel (Experimental)☆33Updated 4 months ago
- Make ai KEY rotation SMARTER and more SECURE; Cloudflare Worker☆381Updated last week
- ☆48Updated 7 months ago
- 简易版api集合器☆90Updated 7 months ago
- ImageHosting Github login + Cloudflare R2 + D1 + Astro SSR | 图床&图片上传☆52Updated 8 months ago
- ☆76Updated last year
- Cloudflare Worker; Claude Code; Proxy; Easy to deploy☆221Updated last week
- 拼好AI(PinAI)是一个简单的AI路由平台,简单就好。☆52Updated last week
- 将Z.ai转换为OpenAI兼容格式的高性能代理,无缝接入 GLM-4.5 系列模型☆77Updated last month
- Claude API Proxy platform - Seamlessly forward Claude Code requests to any OpenAI-compatible API service with smart model mapping, stream…☆215Updated 3 months ago
- A cloudflare worker to covert cohere api to openai API☆37Updated last year
- Visualize OpenRouter CSV usage costs by model and over time.☆175Updated 2 months ago
- 🌐 A simple Cloudflare Worker - Serverless & Cost-Effective: No need to rent or manage your own server. Cloudflare Workers operate on a s…☆298Updated 4 months ago
- 简易cloudflare反代大陆无法直连的大模型api☆177Updated 2 months ago
- 测试claude code公益站使用连通性☆30Updated last month
- 📫 An open source temporary email tool. 只需一个域名部署临时邮箱,支持多域名后缀,密码找回。☆57Updated last month