The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoints across different concurrency levels.
☆96Mar 25, 2026Updated 4 months ago
Alternatives and similar repositories for llmapibenchmark
Users that are interested in llmapibenchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple CLI tool to effortlessly download GGUF model files from Ollama's registry. Once downloaded, these GGUF files can be seamlessly i…☆27Jun 23, 2026Updated last month
- Arch packages for Minecraft☆11Dec 28, 2021Updated 4 years ago
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆431Updated this week
- RWKV v5,v6 LoRA Trainer on Cuda and Rocm Platform. RWKV is a RNN with transformer-level LLM performance. It can be directly trained like …☆13Mar 24, 2024Updated 2 years ago
- 大批量稳定的获取ChatGPT登录的AccessToken，同时增加静态住宅IP代理池。保证批量启动GPT-4服务时，AccessToken增加缓存时间和过期时间校验。☆14Jul 5, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Demonstrate using MCP with Pydantic AI framework☆14Mar 14, 2025Updated last year
- Polyglot is a fast, elegant, and free translation tool using AI.☆66Nov 21, 2025Updated 8 months ago
- An simple pytorch implementation of Flash MultiHead Attention☆22Feb 5, 2024Updated 2 years ago
- This repository contains server and extension to make possible to move ZenBrowser window by dragging any web page Header, Class element o…☆12Mar 29, 2025Updated last year
- A simple, cross-platform CLI tool for quickly switching between Claude Code configuration profiles by managing different settings.json ve…☆16Jan 17, 2026Updated 6 months ago
- A Model Context Protocol (MCP) server that enables communication and coordination between multiple AI agents☆32Sep 8, 2025Updated 11 months ago
- Generate a wiki for your research topic, sourcing from the web and your docs.☆58Mar 8, 2025Updated last year
- ☆62Dec 10, 2025Updated 8 months ago
- Yuren 13B is an information synthesis large language model that has been continuously trained based on Llama 2 13B, which builds upon the…☆15Sep 25, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- SRV record support for legacy systems via LD_PRELOAD getaddrinfo/connect hooks☆14Aug 20, 2015Updated 10 years ago
- Simple TabTip / Virtual Keyboard integration for WPF apps on Win10 with mixed Touchscreen & Keyboard☆10Jun 12, 2021Updated 5 years ago
- This is a companion software based on the Acunetix Web Vulnerability Scanner 13 scanning engine.☆10Oct 17, 2020Updated 5 years ago
- Online search from your terminal using Perplexity AI☆17Sep 22, 2025Updated 10 months ago
- Cython bindings for Turbo Base64☆15Aug 7, 2023Updated 3 years ago
- ☆12May 14, 2025Updated last year
- ❇️ The best modules for Markov Logic Networks condensed in one framework.☆13Dec 20, 2017Updated 8 years ago
- ☆10Feb 18, 2024Updated 2 years ago
- ☆15May 28, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13May 30, 2025Updated last year
- Break standard network functions using LD_PRELOAD☆14Nov 9, 2015Updated 10 years ago
- A project designed to extract relevant metadata from databases and transform it into context for Retrieval-Augmented Generation (RAG) in …☆14Aug 6, 2025Updated last year
- A chat implementation for FastHTML☆12Sep 14, 2025Updated 10 months ago
- Rust SDK and CLI for Swarm Framework with Multi-Agent Orchestration☆17Apr 10, 2025Updated last year
- PyInstaller for Linux and Windows inside Docker☆11Apr 7, 2024Updated 2 years ago
- Computes and displays the visual differences between two URLs☆12Aug 17, 2022Updated 3 years ago
- A lightweight React hook that automatically manages fade overlays for scrollable containers. Provides smooth gradient transitions at the …☆12Aug 11, 2025Updated 11 months ago
- ☆17Mar 22, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆11Mar 6, 2024Updated 2 years ago
- Wrinkl is an AI context management system with ledger-based feature tracking for better AI-assisted development☆34Jul 20, 2025Updated last year
- 使用rag来学习rag☆10Sep 6, 2024Updated last year
- Trained BERT and Word2Vec legal clause classifiers for SPACY using the Atticus Project's Open Source Contract Label Corpus☆14Jan 2, 2021Updated 5 years ago
- ChatGPT-like interface for working with AI Agents☆20Sep 18, 2024Updated last year
- ☆14Mar 30, 2025Updated last year
- ☆13Jun 7, 2025Updated last year