Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.
☆24Jul 19, 2026Updated 2 weeks ago
Alternatives and similar repositories for llm-bench-rig
Users that are interested in llm-bench-rig are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Meta-research lab for domain chip R&D, methodology improvement, and recursive self-improvement☆22Jul 26, 2026Updated last week
- DeepSeek V4 Flash specific inference engine. SSD MoE expert paging (slot-bank) + disk KV cache for long agent sessions. Metal-first, narr…☆29Jul 18, 2026Updated 2 weeks ago
- Some benchmark results of small models and quants that fit on DGX Spark☆49Updated this week
- Serve the home! Inference stack for your Nvidia DGX Spark aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for no…☆51Updated this week
- support kubernetes feature for autogen(https://github.com/microsoft/autogen)☆11Sep 15, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- How to create a private Epstein search engine☆17Feb 13, 2026Updated 5 months ago
- ☆43Jun 15, 2026Updated last month
- bf16 LoRA fine-tuning of [Qwen3.5-35B-A3B](https://huggingface.co/unsloth/Qwen3.5-35B-A3B) (a 35B-total / 3B-active Mixture-of-Experts vi…☆15Mar 12, 2026Updated 4 months ago
- Links to all the source code and solutions I reference in my O'Reilly Introduction to Docker video tutorial☆11Dec 10, 2014Updated 11 years ago
- Live dashboard: fire N parallel streaming coding-agent runs at any OpenAI-compatible endpoint — per-run TTFT/tok-s/E2E, real kill switch,…☆23Jul 23, 2026Updated last week
- An llm wrapper for OpenAI☆13Dec 14, 2024Updated last year
- ☆10Jul 14, 2025Updated last year
- Drop-in prompt-caching fixes for the LLM agent harness you use. Point your AI coding agent at this repo and it ships the patches.☆111Jul 10, 2026Updated 3 weeks ago
- ☆10Dec 19, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Instant Neural Graphics Primitives from scratch, zero dependencies. Learning by doing.☆10Aug 18, 2023Updated 2 years ago
- simple way to preprompt LLMs☆19Oct 22, 2024Updated last year
- Hermes Relay for Chrome gives Hermes Agent a direct browser surface for page context, capture, watchlists, and AI handoff.☆22May 4, 2026Updated 3 months ago
- Zig Llama2 implementation in WGSL with Mach backend.☆12Oct 4, 2023Updated 2 years ago
- Autonomous self-improving 4x DGX Spark (GB10) MoA stack + LoRA loop (DSV4F router, Qwen3.6/Omni/TwoTower/Gemma). Hermes MoA routing, ~90%…☆18Jul 5, 2026Updated 3 weeks ago
- Font Awesome for Plone☆11Aug 1, 2018Updated 8 years ago
- This includes 2 separate tutorial series for OpenAI swarm library each 10 files from basic to advanced☆14Jan 14, 2025Updated last year
- Apps that run on modal.com☆13Sep 14, 2025Updated 10 months ago
- Flexible, efficient, and context-aware generation from large unstructured knowledge sources.☆17May 7, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. …☆18Jul 8, 2024Updated 2 years ago
- Proteus 2.0☆10Updated this week
- DeepDip, a DRL Gym agent that plays no-press Diplomacy in BANDANA☆13Jul 22, 2019Updated 7 years ago
- A fuzzy key value store based on semantic similarity rather lexical equality. (python version)☆14Aug 5, 2024Updated last year
- "QuantumQrew: Leveraging SuperAGI to automatically summarize web content scraped from URLs and deliver summaries to email inboxes. Revolu…☆17Aug 21, 2023Updated 2 years ago
- A Discord bot for Automatic1111's Stable Diffusion web UI☆10May 18, 2025Updated last year
- ☆18Jan 9, 2024Updated 2 years ago
- Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)☆11Jul 19, 2024Updated 2 years ago
- ☆16Oct 4, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A collection of my favourite workflows☆10Dec 31, 2024Updated last year
- ☆68Jun 4, 2026Updated last month
- Parse a Links header into a JavaScript object.☆15Dec 3, 2015Updated 10 years ago
- ☆23Jul 11, 2026Updated 3 weeks ago
- An SQL query application. Allows you to inspect your databases and query them easily. Similar to microsoft's query analyzer/sql server ma…☆11Jan 7, 2013Updated 13 years ago
- ☆12May 31, 2023Updated 3 years ago
- ☆21Jun 12, 2026Updated last month