Lightweight eval framework for MCP servers, built on mcp-agent
☆35Nov 19, 2025Updated 9 months ago
Alternatives and similar repositories for mcp-eval
Users that are interested in mcp-eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Natural language to bash commands. Run, understand, copy bash commands generated by an LLM☆26Feb 4, 2026Updated 6 months ago
- LLM code editor for backend services☆16Oct 19, 2024Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆35Apr 17, 2025Updated last year
- A simple job scheduler backed by Postgres.☆16May 31, 2021Updated 5 years ago
- a CLI and set of agent skills to prototype custom scenes with coding agents like Codex and Claude Code.☆15May 28, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated last year
- ☆12Aug 24, 2021Updated 5 years ago
- A command line tool to execute simple file conversions, image/video manipulations and folder changes.☆16Jul 8, 2024Updated 2 years ago
- ☆16Feb 22, 2026Updated 6 months ago
- train entropix like a champ!☆20Oct 10, 2024Updated last year
- Mine-tuning is a methodology for synchronizing human and AI attention.☆21Jun 16, 2024Updated 2 years ago
- Orchestrator is a single-binary workflow orchestration tool.☆19Jul 13, 2026Updated last month
- ☆21Jun 5, 2026Updated 2 months ago
- nixos + nomad configs for my homelab☆31Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scalable, cloud-native infrastructure for evaluating AI agents across any benchmark.☆33Updated this week
- A couple scripts to grab stats from email☆43Sep 10, 2024Updated last year
- Allows Aider to use CEDARScript as an edit format☆30Dec 3, 2024Updated last year
- Build Web Datasets with Ease☆33Jun 23, 2024Updated 2 years ago
- A macOS version of the oobabooga gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA…☆25Updated this week
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆10Oct 11, 2024Updated last year
- ☆56Apr 14, 2023Updated 3 years ago
- ☆20Jul 7, 2026Updated last month
- AI eXplainable Inference & Search. Open Sourcing on-premise, ultra-fast latency intelligence to all.☆37Feb 28, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- 中文金融大模型测评基准，六大类二十五任务、等级化评价，国内模型获得A级☆10May 6, 2024Updated 2 years ago
- ☆42Jun 18, 2026Updated 2 months ago
- Access the Cohere Command R family of models☆39Mar 28, 2025Updated last year
- Comind, the cognitive layer for the web.☆26Jun 10, 2025Updated last year
- ☆13Mar 5, 2025Updated last year
- Code and data for automatic paraphrase dataset augmentation.☆11Mar 8, 2021Updated 5 years ago
- ☆11Jan 3, 2024Updated 2 years ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆51Sep 29, 2024Updated last year
- ☆40Feb 5, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- LGEB: Benchmark of Language Generation Evaluation☆16Oct 21, 2022Updated 3 years ago
- ☆39Apr 15, 2026Updated 4 months ago
- Low code tool to rapidly build and coordinate multi-agent teams☆1,084Oct 27, 2025Updated 10 months ago
- Code for our project CROWN (Conversational Passage Ranking by Reasoning over Word Networks)☆10Jan 11, 2024Updated 2 years ago
- Math-aware QA system☆18May 8, 2026Updated 3 months ago
- An application built on the Model Context Protocol (MCP) that transforms any website into highly relevant content based on your queries. …☆63Apr 18, 2025Updated last year
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆14Oct 12, 2024Updated last year