Ranking LLMs on agentic tasks
β226May 21, 2026Updated 4 months ago
Alternatives and similar repositories for agent-leaderboard
Users that are interested in agent-leaderboard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python client library for the Galileo platform πβ22Oct 2, 2026Updated last week
- Details and sample code for the Eval Engineering courseβ16Jan 27, 2026Updated 8 months ago
- [KDD24-ADS] R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Modelsβ11Apr 9, 2024Updated 2 years ago
- β15Sep 23, 2026Updated 2 weeks ago
- Reproducible Language Agent Researchβ36Jun 25, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Validation, JSON & OpenAPI Schema for Go with Union support. Inspired by Pydantic & FastAPI.β32Mar 11, 2026Updated 6 months ago
- Centralized agent control plane for governing runtime agent behavior at scale. Configurable, extensible, and production-ready.β320Updated this week
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"β72Dec 9, 2024Updated last year
- β24Nov 4, 2024Updated last year
- PyTorch speech2text inference script for the NVidia openseq2seq wav2letter model variantβ10Aug 12, 2019Updated 7 years ago
- MCP-based Agent Deep Evaluation Systemβ155Jun 2, 2026Updated 4 months ago
- Experiments on speech recognition robustness to accents and dialectsβ12Apr 2, 2019Updated 7 years ago
- Complex Function Calling Benchmark.β181Jan 20, 2025Updated last year
- Chaos engineering for AI agentsβ34Jan 2, 2026Updated 9 months ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Baker is an AI powered app that helps you find recipes and avoid food wasteβ14Jan 4, 2025Updated last year
- This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Eβ¦β1,429Jul 18, 2025Updated last year
- A tool to assist in the interpretation of learned features in sparse autoencoders (in particular the four SAE's trained by Joseph Bloom oβ¦β19Oct 4, 2024Updated 2 years ago
- π² An agent for sourcing, curating, and scheduling social media posts with human-in-the-loop.β13Apr 18, 2025Updated last year
- An agentic AI application that allows you to chat with your papers and gather also information from papers on ArXiv and on PubMedβ157May 18, 2025Updated last year
- UQ: Assessing Language Models on Unsolved Questionsβ30Aug 26, 2025Updated last year
- [NAACL 2025] Representing Rule-based Chatbots with Transformersβ23Feb 9, 2025Updated last year
- "Syntriever: How to Train Your Retriever with Synthetic Data from LLMs" the Nations of the Americas Chapter of the Association for Computβ¦β29Mar 5, 2025Updated last year
- Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".β692Jun 18, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer β’ AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- It shows a problem solver based on agentic workflow.β16Mar 1, 2025Updated last year
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"β24Apr 30, 2025Updated last year
- Structured Prompts Improve Evaluation of Language Modelsβ15Jun 5, 2026Updated 4 months ago
- fast trainer for educational purposesβ27Sep 12, 2026Updated 3 weeks ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created byβ¦β35Aug 24, 2024Updated 2 years ago
- A repository for my PyCon talk: "Building a personal assistant with Haystack and GPT: How to feed facts to large language models and reduβ¦β19Apr 16, 2023Updated 3 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy modβ¦β15Apr 21, 2023Updated 3 years ago
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) withβ¦β23Jan 7, 2024Updated 2 years ago
- β32Jun 5, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β32Sep 19, 2025Updated last year
- β310Jul 1, 2026Updated 3 months ago
- FinanceRAG project by KAIST students. Advanced Retrieval-Augmented Generation (RAG) system designed for the financial domain.β18Feb 11, 2025Updated last year
- Public Evaluation Result Archieve for BFCLβ33Sep 7, 2026Updated last month
- β47Jul 10, 2024Updated 2 years ago
- a single interface around speech-to-speech foundation modelsβ28Jun 27, 2025Updated last year
- Chain-of-thought λ°©μμ νμ©νμ¬ llama2λ₯Ό fine-tuningβ10Nov 18, 2023Updated 2 years ago