Test LLMs on real tasks. Compare models side-by-side.
☆429Aug 10, 2026Updated 2 months ago
Alternatives and similar repositories for BenchLocal
Users that are interested in BenchLocal are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆342May 15, 2026Updated 5 months ago
- ☆12May 15, 2026Updated 5 months ago
- ☆32May 15, 2026Updated 5 months ago
- Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.☆45Aug 16, 2026Updated 2 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆68Jun 4, 2026Updated 4 months ago
- CLI port of BenchLocal quality bench packs — runs LLM behavioral evals against any OpenAI-compatible endpoint. Companion to club-3090.☆20Oct 16, 2026Updated 2 weeks ago
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 4 months ago
- MLX Model Quantization Toolkit - Comprehensive collection of Jupyter notebooks for converting and quantizing large language models usi…☆15Aug 16, 2025Updated last year
- Local-first AI workbench for OCR, transcription, translation, image generation, mind maps and composable workflows. Built for DGX Spark.☆68Sep 2, 2026Updated last month
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆407Updated this week
- 📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual b…☆105Oct 15, 2026Updated 2 weeks ago
- Control panel for VLLM, Sglang, llama.cpp, exllamav3☆1,836Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,964Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆791Aug 20, 2026Updated 2 months ago
- Find the hidden meaning of LLMs☆42Nov 13, 2025Updated 11 months ago
- ☆37Mar 30, 2026Updated 7 months ago
- Experimental llama.cpp fork for inference research and development☆893Updated this week
- Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, option…☆48Oct 13, 2026Updated 2 weeks ago
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,208Aug 18, 2026Updated 2 months ago
- Structured Chain-of-Thought☆221May 16, 2026Updated 5 months ago
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆481Oct 14, 2026Updated 2 weeks ago
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆20Apr 11, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Moshi-Finetune-MLX lets you fine-tune Moshi (Native, Real-Time, Speech-to-Speech) models all on Apple Silicon.☆26Apr 21, 2026Updated 6 months ago
- Flash-MoE sidecar slot-bank runtime for large GGUF MoE models on Apple Silicon — llama.cpp fork☆134Oct 7, 2026Updated 3 weeks ago
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 7 months ago
- We gave AI models telepathy.☆21Sep 25, 2026Updated last month
- A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.☆177Updated this week
- [ICLR 2026] ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference☆345Aug 19, 2026Updated 2 months ago
- ☆17Sep 29, 2026Updated last month
- extract all your personal data history from cursor, codex, claude-code, windsurf, and trae☆1,352Oct 7, 2026Updated 3 weeks ago
- Hermes Agent benchmark v0.1 — evaluate local models on the actual tool-calling patterns Hermes users hit. Reproducible, trace-capturing, …☆17Jun 24, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Drop-in prompt-caching fixes for the LLM agent harness you use. Point your AI coding agent at this repo and it ships the patches.☆116Aug 29, 2026Updated 2 months ago
- Benchmark to measure what the real knowledge cutoff of a model is☆20Oct 13, 2026Updated 2 weeks ago
- vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon☆274Jun 3, 2026Updated 4 months ago
- A local-first AI companion that keeps watching while nobody is talking, so it can tell you what you were doing five minutes ago. Runs ent…☆10Jul 29, 2026Updated 3 months ago
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 6 months ago
- A language model that forms persistent memories from conversation and maintains them through sleep. MEMIT weight editing + null-space-con…☆79Oct 11, 2026Updated 2 weeks ago
- Train Large Language Models on MLX.☆468Updated this week