llama-benchy - llama-bench style benchmarking tool for all backends
☆553Jul 10, 2026Updated this week
Alternatives and similar repositories for llama-benchy
Users that are interested in llama-benchy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems☆383Updated this week
- Docker configuration for running VLLM on dual DGX Sparks☆1,833Updated this week
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆196Jul 6, 2026Updated last week
- 4-5x faster Qwen3.5 on ASUS GX10 / DGX Spark — Hybrid INT4+FP8 + MTP via one shell script☆31Apr 16, 2026Updated 2 months ago
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆122Feb 22, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Qwen3.5-122B-A10B on DGX Spark: 28.3 → 51 tok/s (+80%)☆273Jun 2, 2026Updated last month
- A dynamic multi-expert AI architecture running on a single consumer GPU (RTX 3060).☆36Dec 2, 2025Updated 7 months ago
- Loader extension for tabbyAPI in SillyTavern☆27Jun 30, 2025Updated last year
- Golang Automation Framework for Cobalt Strike using the Rest API☆60Apr 10, 2026Updated 3 months ago
- Kiwix ZIM-to-vector RAG system for local, offline LLM knowledge retrieval☆29Mar 24, 2026Updated 3 months ago
- QuickClash Revit Add-in for Clash Detection☆12Jun 17, 2022Updated 4 years ago
- ☆25Oct 13, 2025Updated 9 months ago
- Serverless RAG application with LlamaIndex and code interperter on Azure Container Apps☆13Jan 30, 2026Updated 5 months ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Merge LLM that are split in to parts☆26Mar 18, 2026Updated 3 months ago
- A batteries included starter for building an API using bun and Elysia☆16Sep 16, 2025Updated 9 months ago
- LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.☆65Jan 5, 2025Updated last year
- Test LLMs on real tasks. Compare models side-by-side.☆373Jun 16, 2026Updated 3 weeks ago
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆22Mar 6, 2026Updated 4 months ago
- Open source implementation for computer use, using light OCR models and LLMs. Get Android app in link below.☆30Apr 3, 2026Updated 3 months ago
- Quantized text-audio foundation model from Boson AI☆42Aug 13, 2025Updated 11 months ago
- ☆13May 19, 2023Updated 3 years ago
- ☆65Apr 16, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Ultimate Persona is an all-in-one persona generator and plot hook creator for SillyTavern. It uses pre-existing character cards to shape …☆44Dec 30, 2025Updated 6 months ago
- My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.☆46Jan 27, 2026Updated 5 months ago
- Current Alpha version of the ONTO-TRON-5000☆42Dec 1, 2025Updated 7 months ago
- ☆43Jan 2, 2026Updated 6 months ago
- molequla.ai. live ecology of GPT organisms☆52Jul 4, 2026Updated last week
- LLM inference in C/C++☆63May 7, 2026Updated 2 months ago
- Cross-GPU KV Cache Marketplace☆25Nov 12, 2025Updated 8 months ago
- Mindwrite, is simple flutter project with clean architecture and Bloc☆15Oct 24, 2024Updated last year
- Ultrafast CLI on Apple Silicon macOS for fast, sandboxed development and LLM agents.☆192Feb 18, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Run vLLM on 1-to-N NVIDIA DGX Spark servers (single Spark, 2 via direct cable, or 3+ via switched fabric) to serve or benchmark LLMs☆122Jun 22, 2026Updated 3 weeks ago
- ☆71Mar 12, 2026Updated 4 months ago
- Implements harmful/harmless refusal removal using pure HF Transformers☆21May 8, 2025Updated last year
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆31Jul 18, 2024Updated last year
- Official RepRapFirmware Configuration Tool☆14Jun 29, 2026Updated 2 weeks ago
- ☆34Feb 18, 2025Updated last year
- Rewritten frontend for SillyTavern☆85Updated this week