JohnMing143 / llm-api-speedtesterLinks
这是一个部署在 Cloudflare Worker 上的小工具,用于测试大语言模型 (LLM) API 的调用速度和性能。它可以测量不同输入和输出 Token 组合下的吞吐量 (tokens/sec) 和首个 Token 的平均响应延迟。
☆23Updated last month
Alternatives and similar repositories for llm-api-speedtester
Users that are interested in llm-api-speedtester are comparing it to the libraries listed below
Sorting:
- OpenAI compatible /chat/completions endpoint for fal.ai☆40Updated 2 weeks ago
- ☆45Updated 2 months ago
- A MCP server for automated website deployment to 1Panel (Experimental)☆32Updated last month
- A list of projects that enables you to use GPT-3.5 for free☆41Updated last year
- ☆65Updated 2 months ago
- 一个轻量级的域名重定向服务,支持多目标轮询转发。该服务可以根据配置的域名映射规则,将请求转发到不同的目标地址,并支持轮询负载均衡。☆36Updated 2 months ago
- 借助cloudflare tunnel实现在容器平台的frp内网穿透☆40Updated 2 months ago
- ☆35Updated 3 weeks ago
- PDF2MD是一个高效的PDF到Markdown转换工具,旨在帮助用户轻松将PDF文档转换为Markdown格式,便于编辑、分享和发布。通过简洁易用的界面和强大的转换功能,PDF2MD成为内容创作者、研究人员和开发者的得力助手。☆159Updated last month
- ✨ 基于 CloudFlare AI & Workers 的免费在线文生图服务☆96Updated last month
- ImageHosting Github login + Cloudflare R2 + D1 + Astro SSR | 图床&图片上传☆48Updated 3 months ago
- 一个简洁优雅的卡片生成工具,让你轻松创建精美的内容卡片。支持自定义内容、多种主题样式和二维码,让创作变得更加简单有趣。☆88Updated 6 months ago
- 一个跑在 Cloudflare Workers 上的图片生成 API 代理,帮你智能优化提示词、代理图片,安全又好用!🚀☆78Updated last month
- 基于 Electron + React + AI 的跨平台桌面应用,自动分析微信群聊内容,生成精美的 AI 日报摘要,支持 macOS、Windows、Linux。☆95Updated 2 weeks ago
- Pure Front-End LLM API Testing Tool☆74Updated 2 months ago
- ☆58Updated 4 months ago
- Use Github LLM in Telegram☆43Updated 7 months ago
- This plugin allows you to open your Obsidian vault or current file in your favorite IDE or text editor. Support VSCode, Cursor, Windsurf,…☆23Updated 3 months ago
- Cloudflare Worker SSL Certificate Application Agent☆50Updated 3 weeks ago
- 基于 doocs/md 开发的微信编辑器桌面应用☆56Updated 2 months ago
- 这是一个基于 Cloudflare Workers 和 D1 数据库的应用,可以通过编写 SQL 查询快速创建 REST API 接口。☆155Updated 2 weeks ago
- ☆75Updated 9 months ago
- (非官方)Juchats API☆32Updated 2 months ago
- hybrid thinking (aka deepclaude) in open-webui☆41Updated 2 months ago
- 基于 Google Gemini AI 的全功能图像处理应用☆203Updated last week
- 易用的文件上传工具,专为多文件和大文件处理而优化,可以将文件轻松上传到 Cloudflare R2 存储。☆119Updated 2 months ago
- Ortlin - OpenAI User Interface☆57Updated 7 months ago
- Unified management of projects with large model APIs, unified conversion to OpenAI format, calling multiple backend services, OpenAI, Ant…☆128Updated 6 months ago
- ☆33Updated last month
- This is a simple Cloudflare Worker that transform Cohere API to OpenAI API, easily deployable to Cloudflare Workers.☆42Updated 3 months ago