JohnMing143 / llm-api-speedtesterLinks
这是一个部署在 Cloudflare Worker 上的小工具,用于测试大语言模型 (LLM) API 的调用速度和性能。它可以测量不同输入和输出 Token 组合下的吞吐量 (tokens/sec) 和首个 Token 的平均响应延迟。
☆23Updated 7 months ago
Alternatives and similar repositories for llm-api-speedtester
Users that are interested in llm-api-speedtester are comparing it to the libraries listed below
Sorting:
- OpenAI compatible /chat/completions endpoint for fal.ai☆49Updated 3 weeks ago
- Pure Front-End LLM API Testing Tool☆76Updated 8 months ago
- Unified management of projects with large model APIs, unified conversion to OpenAI format, calling multiple backend services, OpenAI, Ant…☆136Updated 3 months ago
- 借助cloudflare tunnel实现在容器平台的frp内网穿透☆48Updated 8 months ago
- API 代理服务☆88Updated 2 months ago
- 一个跑在 Cloudflare Workers 上的图片生成 API 代理,帮你智能优化提示词、代理图片,安全又好用!🚀☆83Updated 7 months ago
- This is a web application designed to browse, filter, sort, and manage free models available on OpenRouter. It allows users to easily sel…☆90Updated 3 months ago
- A MCP server for automated website deployment to 1Panel (Experimental)☆33Updated 5 months ago
- Cloudflare Worker; Claude Code; Proxy; Easy to deploy☆230Updated last month
- 简易版api集合器☆91Updated 8 months ago
- only one claude code proxy☆255Updated this week
- Make ai KEY rotation SMARTER and more SECURE; Cloudflare Worker☆387Updated last month
- ZtoApi 是一个高性能的 OpenAI 兼容 API 代理服务器,专为 Z.ai 的 GLM-4.5 和 GLM-4.5V 模型设计。使用 Deno 原生 HTTP API 实现,支持完整的流式和非流式响应,提供实时监控 Dashboard,让你能够无缝地将 Z.ai …☆117Updated 3 months ago
- 一个Prompts管理与测试工具。A Prompts management and testing tool.☆248Updated last month
- A list of projects that enables you to use GPT-3.5 for free☆40Updated last year
- This is a simple Cloudflare Worker that transform Cohere API to OpenAI API, easily deployable to Cloudflare Workers.☆44Updated 9 months ago
- 简易cloudflare反代大陆无法直连的大模型api☆179Updated 3 months ago
- Cloudflare Worker SSL Certificate Application Agent☆69Updated 2 months ago
- ☆47Updated 8 months ago
- Claude API Proxy platform - Seamlessly forward Claude Code requests to any OpenAI-compatible API service with smart model mapping, stream…☆224Updated 4 months ago
- A simple data sync service for KISSS-Translator.☆163Updated 5 months ago
- Ortlin - OpenAI User Interface☆60Updated last year
- Visualize OpenRouter CSV usage costs by model and over time.☆176Updated 3 months ago
- ☆77Updated last year
- ImageHosting Github login + Cloudflare R2 + D1 + Astro SSR | 图床&图片上传☆53Updated 9 months ago
- 🌐 A simple Cloudflare Worker - Serverless & Cost-Effective: No need to rent or manage your own server. Cloudflare Workers operate on a s…☆297Updated 4 months ago
- 基于 doocs/md 开发的微信编辑器桌面应用☆71Updated last month
- Use Github LLM in Telegram☆43Updated last year
- 一个强大的Cloudflare多账号Workers批量管理系统,支持账号管理、批量操作、实时监控和Workers脚本管理。☆159Updated last month
- ☆81Updated 8 months ago