JohnMing143 / llm-api-speedtesterLinks
这是一个部署在 Cloudflare Worker 上的小工具,用于测试大语言模型 (LLM) API 的调用速度和性能。它可以测量不同输入和输出 Token 组合下的吞吐量 (tokens/sec) 和首个 Token 的平均响应延迟。
☆23Updated 4 months ago
Alternatives and similar repositories for llm-api-speedtester
Users that are interested in llm-api-speedtester are comparing it to the libraries listed below
Sorting:
- This is a web application designed to browse, filter, sort, and manage free models available on OpenRouter. It allows users to easily sel…☆74Updated 2 weeks ago
- Pure Front-End LLM API Testing Tool☆76Updated 5 months ago
- OpenAI compatible /chat/completions endpoint for fal.ai☆46Updated 3 months ago
- ZtoApi 是一个高性能的 OpenAI 兼容 API 代理服务器,专为 Z.ai 的 GLM-4.5 和 GLM-4.5V 模型设计。使用 Deno 原生 HTTP API 实现,支持完整的流式和非流式响应,提供实时监控 Dashboard,让你能够无缝地将 Z.ai …☆98Updated 2 weeks ago
- Unified management of projects with large model APIs, unified conversion to OpenAI format, calling multiple backend services, OpenAI, Ant…☆135Updated 2 weeks ago
- API 代理服务☆67Updated this week
- Make ai KEY rotation SMARTER and more SECURE☆352Updated 2 weeks ago
- 简易版api集合器☆89Updated 5 months ago
- 一个跑在 Cloudflare Workers 上的图片生成 API 代理,帮你智能优化提示词、代理图片,安全又好用!🚀☆81Updated 4 months ago
- 借助cloudflare tunnel实现在容器平台的frp内网穿透☆44Updated 5 months ago
- Visualize OpenRouter CSV usage costs by model and over time.☆148Updated 3 weeks ago
- 一个能够在本地共享Plus账号,避免OpenAI标记降智前提下,使用原生网页版ChatGPT Plus的项目☆87Updated 7 months ago
- Claude API Proxy platform - Seamlessly forward Claude Code requests to any OpenAI-compatible API service with smart model mapping, stream…☆183Updated last month
- ☆48Updated 5 months ago
- ☆76Updated last year
- Cloudflare Worker; Claude Code; Proxy; Easy to deploy☆192Updated 2 weeks ago
- Cloudflare Worker SSL Certificate Application Agent☆61Updated this week
- ImageHosting Github login + Cloudflare R2 + D1 + Astro SSR | 图床&图片上传☆49Updated 6 months ago
- 🌐 A simple Cloudflare Worker - Serverless & Cost-Effective: No need to rent or manage your own server. Cloudflare Workers operate on a s…☆287Updated last month
- kiro to claude code☆296Updated last month
- 一个现代化的 Claude API 代理服务,基于 Cloudflare Workers 构建☆212Updated last month
- A MCP server for automated website deployment to 1Panel (Experimental)☆33Updated 2 months ago
- A list of projects that enables you to use GPT-3.5 for free☆41Updated last year
- 基于 Google Gemini AI 的全功能图像处理应用☆219Updated 3 months ago
- GPT-foolproof 防止GPT降智的一个浏览器插件。☆107Updated 7 months ago
- ☆49Updated 3 months ago
- 这是一个基于 Cloudflare Workers 和 D1 数据库的应用,可以通过编写 SQL 查询快速创建 REST API 接口。☆181Updated 3 weeks ago
- ☆81Updated 5 months ago
- A simple data sync service for KISSS-Translator.☆150Updated last month
- 支持HTTP,Websocket,DoH/DoT协议,支持AI API代理,支持流式传输,使用原生 TCP Socket 解决 fetch API 的隐私泄露问题并提供灵活的回退策略解决TCP Socket 目前无法连接到 Cloudflare 自身的 IP 段的问题的Cl…☆205Updated last month