Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.
☆42Oct 25, 2026Updated this week
Alternatives and similar repositories for llm-bench-rig
Users that are interested in llm-bench-rig are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmark Heaven: AI model benchmarks with sources and modeled costs, plus the JevBench and ImageJevBench decision model leaderboards.☆21Updated this week
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 7 months ago
- Free, open-source Whisper desktop app — 100% offline speech-to-text for Windows, macOS & Linux. No cloud, no subscription.☆63Updated this week
- Qwen3.8-27B ADay777-Ablit · NVFP4 · A4Q · NVFP4-KV (4M+ pool) · MTP-3 — single DGX Spark (GB10/sm121), eugr vLLM 0.27. 1M ctx @ c=4.☆24Aug 17, 2026Updated 2 months ago
- ☆22Oct 18, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Autonomous self-improving 4x DGX Spark (GB10) MoA stack + LoRA loop (DSV4F router, Qwen3.6/Omni/TwoTower/Gemma). Hermes MoA routing, ~90%…☆24Aug 17, 2026Updated 2 months ago
- High-performance placement portal featuring role-based access control, PostgreSQL real-time sync, and automated analytics. Powered by Flu…☆20Oct 14, 2026Updated last week
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆25Feb 16, 2026Updated 8 months ago
- A set of PSScriptAnalyzer rules that help make it Good Enough!☆11Aug 26, 2026Updated last month
- Open quantization tooling for TurboQuant-style low-bit LLM releases, stock GGUF deployment, and Apple Silicon runtime experiments.☆10May 5, 2026Updated 5 months ago
- Uncensored/abliterated Ornith-1.0-35B (AEON Ultimate): 0% refusal, 0 coding-capability loss. BF16 + FP8 for vLLM.☆86Oct 6, 2026Updated 2 weeks ago
- An opinionated agentic development layer for OpenCode — spec-first when it matters, review-driven execution, portable model roles, safer …☆16Updated this week
- Self-hosted AI company OS for solo founders: autonomous agents, ERPNext business memory, and owner-visible governance.☆18Updated this week
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆396Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Hermes Agent proficiencies: shareable operating-attribute skills for human SOPs/playbooks, agent skill/tool-SOP building, safe publishing…☆35Jul 13, 2026Updated 3 months ago
- A deterministic Software Development pipeline for you AI agents, written in Kotlin with nice UI for monitoring.☆45Updated this week
- Convert STL meshes to STEP solids with true cylinders, cones, spheres and tori☆15Oct 19, 2026Updated last week
- Single-pass MiniMax H3 image-to-video for ComfyUI (~166s/7s at 704x384 on one RTX 4060 Ti 16GB).☆21Aug 27, 2026Updated last month
- Paste, and drag drop images to load them into Pi. Also works in tmux.☆12May 5, 2026Updated 5 months ago
- SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB G…☆231Sep 1, 2026Updated last month
- autonomous red teaming platform; multi-agent offensive-security meta-harness☆29Jul 6, 2026Updated 3 months ago
- A curated list of awesome local AI projects and repos☆49Updated this week
- Serve the home! Inference stack for your Nvidia DGX / RTX Spark (128GB ram) aka the Grace Blackwell AI supercomputer on your desk. Mostly…☆52Oct 11, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ComfyUI-KokoroTTS: A text-to-speech model that utilizes the Kokoro TTS framework to convert text into natural-sounding speech. It suppor…☆13Apr 18, 2025Updated last year
- This one, you can unmute: a camera flies over a DAW timeline in one shot while a tracker locks onto every beat. Music composed in code, e…☆28Updated this week
- TV transmitter and receiver through RTL-SDR, for educational purposes☆12Oct 27, 2017Updated 8 years ago
- Headless / multi-user serving-mode for the DGX Spark: free unified memory for vLLM by paring back the desktop. Companion to qwen3.5-122B-…☆20Jun 29, 2026Updated 3 months ago
- Skill for Hermes, and other agents, to ask typesafe's jev☆41Sep 17, 2026Updated last month
- Context optimization layer for LLMs. 65-90% token savings with zero quality loss. Drop-in proxy for Claude, GPT, Gemini, and local LLMs (…☆20Sep 5, 2026Updated last month
- PowerShell Module for JWT (JSON Web Tokens)☆17Jun 9, 2020Updated 6 years ago
- A command-line tool to scaffold and manage enterprise-ready AI Agents powered by the A2A (Agent-to-Agent) protocol☆15Updated this week
- Guardian Agent Blackbox: Keep your AI agents safe from being tricked or compromised☆64Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Monitor temperature, control fan speeds, backlight color and more using WMI BIOS and the Embedded Controller. Lightweight, runs in the ba…☆15Oct 16, 2026Updated last week
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated last week
- Portable personal advisor OS built from Agent Skills☆12Aug 12, 2026Updated 2 months ago
- Mixed-vendor GPU inference cluster manager with speculative decoding☆38Jul 2, 2026Updated 3 months ago
- 3D prompts for games, scenes, assets, animation and interactive worlds across Astra, Claude and Kimi. 14 languages, generated from CMS.☆24Oct 2, 2026Updated 3 weeks ago
- Multi-model fusion chat: a master model synthesizes answers from up to three fusion models. TUI + web UI.☆11Jun 29, 2026Updated 3 months ago
- An open research program exploring the mathematics of artificial thought: information geometry, topology, dynamical systems, and thermody…☆17Updated this week