aymeric-roucher / agent_reasoning_benchmark
π§ Compare how Agent systems perform on several benchmarks. ππ
β71Updated 3 months ago
Alternatives and similar repositories for agent_reasoning_benchmark:
Users that are interested in agent_reasoning_benchmark are comparing it to the libraries listed below
- Codebase accompanying the Summary of a Haystack paper.β74Updated 5 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β48Updated 7 months ago
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".β64Updated 7 months ago
- β114Updated 6 months ago
- Beating the GAIA benchmark with Transformers Agents. πβ87Updated this week
- β50Updated 2 months ago
- β78Updated last month
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)β89Updated 3 weeks ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platformβ82Updated last week
- Code for ScribeAgent paperβ50Updated last month
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo rankerβ106Updated last week
- Simple examples using Argilla tools to build AIβ53Updated 3 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"β100Updated 5 months ago
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"β81Updated 4 months ago
- β32Updated 7 months ago
- Mixing Language Models with Self-Verification and Meta-Verificationβ100Updated 2 months ago
- β113Updated 4 months ago
- β108Updated 5 months ago
- β141Updated 7 months ago
- Evaluating LLMs with CommonGen-Liteβ88Updated 11 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Modelsβ100Updated 2 months ago
- Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [Fβ¦β62Updated 8 months ago
- β48Updated 3 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)β100Updated last week
- Just a bunch of benchmark logs for different LLMsβ119Updated 6 months ago
- Official code of the paper "SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generation"β96Updated 2 months ago
- β156Updated 6 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracyβ100Updated 10 months ago
- Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.β90Updated 6 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β64Updated 3 months ago