JohnMing143 / llm-api-speedtesterLinks
这是一个部署在 Cloudflare Worker 上的小工具，用于测试大语言模型 (LLM) API 的调用速度和性能。它可以测量不同输入和输出 Token 组合下的吞吐量 (tokens/sec) 和首个 Token 的平均响应延迟。
☆23Updated 2 months ago
Alternatives and similar repositories for llm-api-speedtester
Users that are interested in llm-api-speedtester are comparing it to the libraries listed below
Sorting:
- OpenAI compatible /chat/completions endpoint for fal.ai☆45Updated last month
- ✨ 基于 CloudFlare AI & Workers 的免费在线文生图服务☆113Updated 2 months ago
- Unified management of projects with large model APIs, unified conversion to OpenAI format, calling multiple backend services, OpenAI, Ant…☆132Updated 8 months ago
- Pure Front-End LLM API Testing Tool☆74Updated 4 months ago
- 一个跑在 Cloudflare Workers 上的图片生成 API 代理，帮你智能优化提示词、代理图片，安全又好用！🚀☆80Updated 2 months ago
- 简易版api集合器☆90Updated 3 months ago
- 🌐 A simple Cloudflare Worker - Serverless & Cost-Effective: No need to rent or manage your own server. Cloudflare Workers operate on a s…☆266Updated last week
- A MCP server for automated website deployment to 1Panel (Experimental)☆33Updated 3 weeks ago
- Cloudflare Worker SSL Certificate Application Agent☆53Updated 2 weeks ago
- A list of projects that enables you to use GPT-3.5 for free☆41Updated last year
- ImageHosting Github login + Cloudflare R2 + D1 + Astro SSR | 图床&图片上传☆48Updated 4 months ago
- 一个现代化的 Claude API 代理服务，基于 Cloudflare Workers 构建☆108Updated this week
- Ortlin - OpenAI User Interface☆59Updated 9 months ago
- ☆47Updated 3 months ago
- This is a simple Cloudflare Worker that transform Cohere API to OpenAI API, easily deployable to Cloudflare Workers.☆43Updated 4 months ago
- 使用Github Action定时爬取推特(Twitter)主页时间线推文，支持手动爬取指定用户的全量推文及媒体，并通过Telegram Bot推送(图片、视频 、GIF)到频道/群组。(无需部署)☆135Updated 2 weeks ago
- ☆76Updated 11 months ago
- huggingface☆7Updated 9 months ago
- 借助cloudflare tunnel实现在容器平台的frp内网穿透☆41Updated 3 months ago
- 一个简洁优雅的卡片生成工具，让你轻松创建精美的内容卡片。支持自定义内容、多种主题样式和二维码，让创作变得更加简单有趣。☆89Updated 8 months ago
- 一个能够在本地共享Plus账号，避 免OpenAI标记降智前提下，使用原生网页版ChatGPT Plus的项目☆87Updated 5 months ago
- PDF2MD是一个高效的PDF到Markdown转换工具，旨在帮助用户轻松将PDF文档转换为Markdown格式，便于编辑、分享和发布。通过简洁易用的界面和强大的转换功能，PDF2MD成为内容创作者、研究人员和开发者的得力助手。☆172Updated 2 months ago
- Provide OpenAI compatible, cost effective and proxied api endpoints on Cloudflare Worker. Foolproof considered☆139Updated last year
- A cloudflare worker to covert cohere api to openai API☆36Updated last year
- PageTalk is a beautiful browser extension that allows you to use Gemini to read page content and have multiple conversations.☆194Updated 3 weeks ago
- 基于 doocs/md 开发的微信编辑器桌面应用☆58Updated 4 months ago
- 这是一个基于 Cloudflare Workers 和 D1 数据库的应用，可以通过编写 SQL 查询快速创建 REST API 接口。☆172Updated last month
- 一个轻量级的域名重定向服务，支持多目标轮询转发。该服务可以根据配置的域名映射规则，将请求转发到不同的目标地址，并支持轮询负载均衡。☆35Updated 3 months ago
- 一个基于USB设备的开源高安全性认证服务解决方案，提供简易U盾实现。将任何U盘变为您的专属安全密钥 (U盾)，无需特定硬件，即插即用。☆47Updated last week
- https://celestialchat.pages.dev/☆150Updated last year