A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API
☆25Aug 1, 2024Updated 2 years ago
Alternatives and similar repositories for llm-speed-benchmark
Users that are interested in llm-speed-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Sep 16, 2024Updated 2 years ago
- ☆14Aug 25, 2024Updated 2 years ago
- ☆16Dec 16, 2024Updated last year
- an auto-sleeping and -waking framework around llama.cpp☆13Feb 8, 2025Updated last year
- ☆12May 30, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)☆12Aug 1, 2025Updated last year
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆42Oct 6, 2024Updated last year
- A simple no-install web UI for Ollama and OAI-Compatible APIs!☆31Jan 30, 2025Updated last year
- LLM inference in C/C++☆17Jul 29, 2026Updated last month
- NodeJS and FFmpeg powered automated creation of video slideshows from input images. Strives for "one config fits all"☆19Jul 22, 2023Updated 3 years ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- Legacy official MegaZeux git repository. Use http://github.com/AliceLR/megazeux instead.☆14Jul 19, 2018Updated 8 years ago
- A Framework for Narrative Agents☆42Mar 2, 2026Updated 6 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Jan 29, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A systematic empirical study of self-verification strategies in agentic coding harnesses☆29Mar 4, 2026Updated 6 months ago
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 3 years ago
- This class supports long-running scripts. (A spin-off from GAS-Terminal)☆33Feb 2, 2022Updated 4 years ago
- ☆43Feb 25, 2026Updated 6 months ago
- LLM fine-tuning with LoRA + NVFP4/MXFP8 on NVIDIA DGX Spark (Blackwell GB10)☆21Dec 22, 2025Updated 9 months ago
- LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.☆68Jan 5, 2025Updated last year
- ☆14Jul 28, 2024Updated 2 years ago
- Multi-agent orchestration framework for AI applications - build, deploy, and manage AI agents across the full lifecycle with Forge, Conve…☆33Mar 28, 2026Updated 5 months ago
- BROKEN REPO. DO NOT USE UNDER ANY CIRCUMSTANCES☆20Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆93Jul 7, 2025Updated last year
- Tiny, composable Atomic CSS engine☆13Apr 1, 2022Updated 4 years ago
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- Vite utility for vue3 server side rendering☆10Jul 21, 2026Updated 2 months ago
- Oobabooga "Hello World" API example for node.js with Express☆13Jul 2, 2023Updated 3 years ago
- Synchronises Ableton Live to a live input such as microphone in the room or DJ playing record☆11Aug 14, 2014Updated 12 years ago
- A collection of reproducible inference engine benchmarks☆38Apr 22, 2025Updated last year
- Adaptive Passage Encoder for Open-domain Question Answering☆15Jun 1, 2021Updated 5 years ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆111Sep 15, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆10Jun 19, 2024Updated 2 years ago
- Dashboard to monitor the performance of your Freqtrade instances☆13Apr 13, 2023Updated 3 years ago
- Mixture-of-Ollamas☆31Aug 12, 2024Updated 2 years ago
- Random Serum Patches☆17Apr 21, 2018Updated 8 years ago
- Implement rest api service for manipulating blog contents using FastAPI in Python☆12Feb 14, 2023Updated 3 years ago
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated last year
- Code for EMNLP2021 paper “Transductive Learning for Unsupervised Text Style Transfer”☆12Sep 19, 2021Updated 5 years ago