Alternatives and similar repositories for benchmark-qed

Users that are interested in benchmark-qed are comparing it to the libraries listed below

• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆194Updated last month
• LHRLAB / Graph-R1
  Graph-R1: Towards Agentic GraphRAG Framework via End-to-end Reinforcement Learning
  ☆410Updated 3 weeks ago
• vectara / open-rag-eval
  Open source RAG evaluation package
  ☆312Updated last week
• apple / ml-superposition-prompting
  ☆146Updated last year
• AgnostiqHQ / multi-agent-llm
  Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)
  ☆120Updated 8 months ago
• google / lmeval
  ☆232Updated 3 months ago
• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆54Updated 2 months ago
• jkanalakis / deep-recall
  Enterprise-grade memory framework for LLMs featuring GPU-optimized inference, vector storage, and automated scaling. Enables hyper-person…
  ☆88Updated 5 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆168Updated last week
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆135Updated last month
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆119Updated last week
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆228Updated 2 weeks ago
• BUPT-GAMMA / PathRAG
  ☆271Updated 7 months ago
• meta-llama / prompt-ops
  An open-source tool for LLM prompt optimization.
  ☆657Updated 2 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆230Updated last year
• Not-Diamond / awesome-ai-model-routing
  A curated list of awesome approaches to AI model routing
  ☆160Updated 6 months ago
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆241Updated last year
• wgcyeo / UniversalRAG
  UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities
  ☆124Updated 4 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆119Updated 3 months ago
• chroma-core / context-rot
  This repository contains the toolkit for replicating results from our technical report.
  ☆148Updated last month
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 2 weeks ago
• ibm-granite / granite-3.0-language-models
  ☆264Updated 3 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆102Updated 6 months ago
• kolenaIO / autoarena
  Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
  ☆105Updated 10 months ago
• SalesforceAIResearch / SFR-RAG
  ☆78Updated 9 months ago
• microsoft / mcp-interviewer
  Catch MCP server issues before your agents do.
  ☆121Updated this week
• YZ-Cai / SimGRAG
  Official code of the ACL 2025 paper "SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generation"
  ☆125Updated 2 months ago
• microsoft / sammo
  A library for prompt engineering and optimization (SAMMO = Structure-aware Multi-Objective Metaprompt Optimization)
  ☆731Updated 3 months ago
• ali-bahrainian / RAG_best_practices
  ☆95Updated 6 months ago
• NVIDIA-AI-Blueprints / aiq-research-assistant
  ☆193Updated this week