Test LLMs on real tasks. Compare models side-by-side.
☆434Aug 10, 2026Updated 3 months ago
Alternatives and similar repositories for BenchLocal
Users that are interested in BenchLocal are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆342May 15, 2026Updated 6 months ago
- ☆31May 15, 2026Updated 6 months ago
- ☆12May 15, 2026Updated 6 months ago
- Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.☆45Aug 16, 2026Updated 3 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆62Apr 18, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆68Jun 4, 2026Updated 5 months ago
- CLI port of BenchLocal quality bench packs — runs LLM behavioral evals against any OpenAI-compatible endpoint. Companion to club-3090.☆20Updated this week
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 5 months ago
- MLX Model Quantization Toolkit - Comprehensive collection of Jupyter notebooks for converting and quantizing large language models usi…☆15Aug 16, 2025Updated last year
- Local-first AI workbench for OCR, transcription, translation, image generation, mind maps and composable workflows. Built for DGX Spark.☆70Sep 2, 2026Updated 2 months ago
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆435Updated this week
- Control panel for VLLM, Sglang, llama.cpp, exllamav3☆1,852Oct 26, 2026Updated 3 weeks ago
- Lucebox inference engine for heterogeneous hardware & consumer GPUs☆3,023Updated this week
- Find the hidden meaning of LLMs☆41Nov 13, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual b…☆107Oct 15, 2026Updated last month
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆794Aug 20, 2026Updated 3 months ago
- ☆37Mar 30, 2026Updated 7 months ago
- Experimental llama.cpp fork for inference research and development☆910Nov 13, 2026Updated last week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,254Aug 18, 2026Updated 3 months ago
- Structured Chain-of-Thought☆221May 16, 2026Updated 6 months ago
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆20Apr 11, 2026Updated 7 months ago
- Moshi-Finetune-MLX lets you fine-tune Moshi (Native, Real-Time, Speech-to-Speech) models all on Apple Silicon.☆26Apr 21, 2026Updated 6 months ago
- Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, option…☆48Oct 13, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆489Oct 14, 2026Updated last month
- Flash-MoE sidecar slot-bank runtime for large GGUF MoE models on Apple Silicon — llama.cpp fork☆135Oct 7, 2026Updated last month
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 8 months ago
- Open source, clear, transparent, real world llm benchmarks☆101Updated this week
- Auto researching harness that burns through everything.☆107Updated this week
- [ICLR 2026] ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference☆346Aug 19, 2026Updated 3 months ago
- ☆17Sep 29, 2026Updated last month
- Drop-in prompt-caching fixes for the LLM agent harness you use. Point your AI coding agent at this repo and it ships the patches.☆117Aug 29, 2026Updated 2 months ago
- vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon☆274Jun 3, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- extract all your personal data history from cursor, codex, claude-code, windsurf, and trae☆1,354Oct 7, 2026Updated last month
- A local-first AI companion that keeps watching while nobody is talking, so it can tell you what you were doing five minutes ago. Runs ent…☆10Jul 29, 2026Updated 3 months ago
- Hermes Agent benchmark v0.1 — evaluate local models on the actual tool-calling patterns Hermes users hit. Reproducible, trace-capturing, …☆17Jun 24, 2026Updated 4 months ago
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆146Apr 15, 2026Updated 7 months ago
- A language model that forms persistent memories from conversation and maintains them through sleep. MEMIT weight editing + null-space-con…☆85Oct 11, 2026Updated last month
- Train Large Language Models on MLX.☆473Updated this week
- Exact speculative decoding on Apple Silicon, powered by MLX.☆390Apr 20, 2026Updated 7 months ago
Are these results useful?