Alternatives and similar repositories for agent-spec

Users that are interested in agent-spec are comparing it to the libraries listed below

• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆160Updated 2 weeks ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆143Updated last week
• IBM / eval-assist
  EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other la…
  ☆92Updated 2 weeks ago
• oracle / wayflow
  WayFlow is a powerful, intuitive Python library for building sophisticated AI-powered assistants. It is a reference runtime for Agent Spe…
  ☆139Updated this week
• hljoren / sufficientcontext
  Official page for ICLR 2025 paper "Sufficient Context: A New Lens on Retrieval Augmented Generation Systems"
  ☆62Updated 4 months ago
• multi-agent-systems-failure-taxonomy / MAST
  ☆302Updated 4 months ago
• apple / ToolSandbox
  ☆226Updated last month
• IBM / AssetOpsBench
  AssetOpsBench - Industry 4.0
  ☆501Updated this week
• cvs-health / langfair
  LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
  ☆242Updated last week
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆270Updated this week
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆280Updated last month
• ibm-granite / granite-3.0-language-models
  ☆266Updated 5 months ago
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆138Updated 7 months ago
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆200Updated 3 weeks ago
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 2 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆153Updated last year
• VectorInstitute / fed-rag
  A framework for fine-tuning retrieval-augmented generation (RAG) systems.
  ☆137Updated last week
• compound-ai-systems / awesome-compound-ai-systems
  A curated list of awesome Compound AI Systems
  ☆35Updated 5 months ago
• facebookresearch / CRAG
  Comprehensive benchmark for RAG
  ☆245Updated 6 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆236Updated last year
• stanford-futuredata / FrugalGPT
  FrugalGPT: better quality and lower cost for LLM applications
  ☆245Updated 10 months ago
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆283Updated this week
• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆212Updated last week
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆173Updated last week
• meta-pytorch / OpenEnv
  An interface library for RL post training with environments.
  ☆829Updated this week
• asimsinan / LLM-Research
  A collection of LLM related papers, thesis, tools, datasets, courses, open source models, benchmarks
  ☆60Updated last year
• ulab-uiuc / MARBLE
  (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…
  ☆192Updated last month
• structuredllm / syncode
  Efficient and general syntactical decoding for Large Language Models
  ☆307Updated 2 weeks ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆102Updated last year
• cuga-project / cuga-agent
  CUGA is an open-source generalist agent for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integrations, …
  ☆235Updated 2 weeks ago