An LLM Benchmark evaluation platform for automated model testing and analysis. 面向大语言模型的 Benchmark 自动化评测平台，支持模型测试与结果分析
☆27Aug 15, 2026Updated 2 months ago
Alternatives and similar repositories for evalhub
Users that are interested in evalhub are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A self-hosted RAG agent platform for knowledge management, LLM orchestration, and MCP tool integration. 面向知识管理、LLM 编排与 MCP 工具集成的自托管 RAG 智…☆89Aug 18, 2026Updated 2 months ago
- Tame3D research framework: evidence-grounded multi-agent 3D reasoning with scene-level conformal uncertainty alignment☆141Sep 28, 2026Updated last month
- Native macOS agent control for Codex and Claude — monitor, approve, ask, and jump back from the menu bar.☆96Aug 11, 2026Updated 3 months ago
- Cross-device Obsidian activity heatmap with mobile tasks, edit timelines, AI summaries, and customizable panel themes☆106Oct 19, 2026Updated 3 weeks ago
- A curated list of AI video and AI drama generators and the open-weight video models behind them, one line each with the official link.☆73Sep 26, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆17Aug 5, 2026Updated 3 months ago
- ☆972Jul 22, 2026Updated 3 months ago
- Audit AI chat exports locally before sharing or migration. Find possible secrets, personal-data patterns, broken JSON/JSONL, SQLite issue…☆986Nov 2, 2026Updated last week
- A compact, schema-driven open source alternative to OpenAI ChatKit widgets.☆297Updated this week
- Build your AI company in minutes. Your data never leaves your machine.☆105Sep 16, 2026Updated last month
- Open-source footage search, research workspace & link downloader for macOS and Windows.☆131Sep 17, 2026Updated last month
- Project page and resources for AR-OPD: Anchored Residual Guidance for Privileged On-Policy Distillation.☆21Jun 10, 2026Updated 5 months ago
- ☆292Sep 27, 2026Updated last month
- A correctness-oriented WebShop prototype with potential-based reward shaping, experimental step-level PPO, provenance, and sealed evaluat…☆20Sep 4, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Build AI agents grounded in a creator's documents, audio, and video.☆974Sep 1, 2026Updated 2 months ago
- Open-source AI CLI and local MCP server connecting 25 clients—Claude Code, Cursor, Codex, ChatGPT, Hermes, and OpenClaw—to 2,000+ models/…☆186Updated this week
- Verify that the PowerPoint you are about to deliver is exactly the PPTX that passed QA—locally, offline, and with tamper-evident evidence…☆982Nov 1, 2026Updated last week
- Yozu web app scaffold for an AI travel decision and execution layer: landing, demo flow, source-backed trip options, approval-gated coord…☆979Jun 9, 2026Updated 5 months ago
- Honeycomb: Constant-Size Scene Memory Representation for Video World Models☆121Oct 25, 2026Updated 2 weeks ago
- ☆27Updated this week
- A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evide…☆1,132Oct 19, 2026Updated 3 weeks ago
- ☆21Aug 6, 2026Updated 3 months ago
- Autonomous LLM Trading Asterism — a research-only multi-agent trading platform with evidence-first research, an auditable console, Shadow…☆1,076Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Self-hosted AI trading terminal for Hyperliquid: chart read in, validated Freqtrade/Nautilus-Trader strategy out, deployed live.☆1,084Nov 3, 2026Updated last week
- ☆955Jun 2, 2026Updated 5 months ago
- Reproducible LLM post-training, evaluation and serving system with PyTorch FSDP2, Qwen3, exact resume and model promotion gates.☆50Sep 2, 2026Updated 2 months ago
- MCP server and Python SDK that generates, runs and refines AI agent workflows from natural language (Generative Workflow, A2A, FastAPI).☆202Updated this week
- Tiri local agent backend and web shell built on agent-runtime.☆707Jul 2, 2026Updated 4 months ago
- 企业级 AI Agent 平台 | Spring Boot 3 + LangChain4j | ReAct 推理 + 多路召回 RAG + 语义缓存 + 多智能体协作☆123Nov 3, 2026Updated last week
- CrewMeld — Enterprise AI Digital Workforce Platform. Manage AI employees like real team members. Visual SOP orchestration, 13 LLM provide…☆1,116Aug 28, 2026Updated 2 months ago
- 🎬 Generate images from any camera viewpoint via 3D interactive control. Drag the camera in 3D space or use sliders to set azimuth/elevat…☆1,005Aug 28, 2026Updated 2 months ago
- 请神 / Summon the spirits you need☆484Apr 7, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A visual chart that shows the relationships among project collaborators, used to provide guidance for new contributors to join the projec…☆21Jan 1, 2026Updated 10 months ago
- SEO foundation checks as an Agent Skill: give it a URL, get a crawler's-eye pass/fail report with evidence. 26 structural checks, zero LL…☆989Updated this week
- Reconcile stuck AI-agent tasks after restarts and timeouts. Preview SQLite changes, close stale delivery states, and never guess success.☆982Nov 1, 2026Updated last week
- Home Environment Ambient Radio-frequency Toolkit for Health☆97Aug 28, 2026Updated 2 months ago
- Neighborhood-scale surface heat research pipeline and interactive Los Angeles atlas☆62Sep 21, 2026Updated last month
- [EMNLP '26 Oral] VITAL: Visual-Semantic Dual Supervision for Enhanced and Interpretable Latent Reasoning in Medical MLLMs☆23Oct 31, 2026Updated last week
- Command-first ATAC-seq footprinting, motif analysis, and reproducible interactive reports☆581Oct 19, 2026Updated 3 weeks ago
Are these results useful?