A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API
☆26Aug 1, 2024Updated 2 years ago
Alternatives and similar repositories for llm-speed-benchmark
Users that are interested in llm-speed-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12May 30, 2025Updated last year
- GLM 5.3 Flash for 2x RTX 6000, Full Mixed EXL3 Support, Code C1 >220tps☆22Oct 25, 2026Updated last week
- an auto-sleeping and -waking framework around llama.cpp☆13Feb 8, 2025Updated last year
- Qwen3.8-27B on DGX Spark (GB10): SGLang + NVFP4 + DFlash2. Measured recipe, benchmark harness, and the traps that cost real time.☆25Aug 25, 2026Updated 2 months ago
- A simple no-install web UI for Ollama and OAI-Compatible APIs!☆31Jan 30, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LLM-only topic extraction and classification☆11Jun 3, 2026Updated 4 months ago
- Colivara Evaluation through vidore benchmarks using ndcg@5 metric.☆12Oct 23, 2026Updated last week
- This project is an app that shows a map with Electric Charging Stations and their information. The app supports station markers clusterin…☆12Jan 15, 2024Updated 2 years ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Jan 29, 2024Updated 2 years ago
- 100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙☆33Aug 29, 2023Updated 3 years ago
- A systematic empirical study of self-verification strategies in agentic coding harnesses☆29Mar 4, 2026Updated 7 months ago
- Convert datasets from Hugging Face to FiftyOne for Visualization☆11Mar 15, 2024Updated 2 years ago
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 3 years ago
- ☆11Jan 28, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Multi-agent orchestration framework for AI applications - build, deploy, and manage AI agents across the full lifecycle with Forge, Conve…☆33Mar 28, 2026Updated 7 months ago
- LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.☆69Jan 5, 2025Updated last year
- A benchmark framework for LLM serving performance, based on API call☆14Apr 15, 2024Updated 2 years ago
- Abliterates models quickly and efficently, Qwen2.5-7B: 95%→2% refusal at 0.095 KL☆39Oct 2, 2026Updated last month
- Source code of ACL2022 "Headed-Span-Based Projective Dependency Parsing" and "Combining (second-order) graph-based and headed-span-based …☆16Jan 12, 2023Updated 3 years ago
- Support library for using ImGui in your CLAP plugin☆11Aug 18, 2026Updated 2 months ago
- source code of COLING2020 "Second-Order Unsupervised Neural Dependency Parsing"☆16Oct 24, 2022Updated 4 years ago
- A Framework for Narrative Agents☆42Mar 2, 2026Updated 8 months ago
- ☆22Aug 26, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- A SpinBox widget prototype for Textual☆11Aug 10, 2025Updated last year
- Oobabooga "Hello World" API example for node.js with Express☆13Jul 2, 2023Updated 3 years ago
- In this solution accelerator, we demonstrate how generative AI, retrieval augmented generation (RAG) and multi stage reasoning can be use…☆16Nov 4, 2024Updated last year
- Rich development workflow with Clojure support, using AstroNvim 4 and selected plugins☆12Jan 21, 2026Updated 9 months ago
- Vite utility for vue3 server side rendering☆10Jul 21, 2026Updated 3 months ago
- Tiny, composable Atomic CSS engine☆13Apr 1, 2022Updated 4 years ago
- LLMPerf is a library for validating and benchmarking LLMs☆13Jan 3, 2025Updated last year
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆114Sep 15, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A local commit gate: runs the linters your repo configures, and sends changed code to an LLM for review☆13Updated this week
- ☆17Aug 29, 2022Updated 4 years ago
- ☆95Jul 7, 2025Updated last year
- LLM Benchmark☆14Dec 17, 2025Updated 10 months ago
- ☆31Oct 24, 2026Updated last week
- ☆10Jun 19, 2024Updated 2 years ago
- npm package template with typescript and tsup☆11Nov 27, 2025Updated 11 months ago