Ranking LLMs on agentic tasks
β227May 21, 2026Updated 5 months ago
Alternatives and similar repositories for agent-leaderboard
Users that are interested in agent-leaderboard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python client library for the Galileo platform πβ22Oct 16, 2026Updated 2 weeks ago
- Details and sample code for the Eval Engineering courseβ17Jan 27, 2026Updated 9 months ago
- Examples on how to get started with the Galileo SDKs for AI Evaluation and Observability (both in Python and Typescript)β19Jul 8, 2026Updated 3 months ago
- Examples of using Galileo for better ML data quality!!β13Feb 5, 2026Updated 8 months ago
- Reproducible Language Agent Researchβ36Jun 25, 2025Updated last year
- Virtual machines for every use case on DigitalOcean β’ AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- NeurIPS 2024: SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretationβ13May 24, 2025Updated last year
- MCP-based Agent Deep Evaluation Systemβ155Jun 2, 2026Updated 5 months ago
- PyTorch speech2text inference script for the NVidia openseq2seq wav2letter model variantβ10Aug 12, 2019Updated 7 years ago
- Centralized agent control plane for governing runtime agent behavior at scale. Configurable, extensible, and production-ready.β332Updated this week
- This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Eβ¦β1,430Jul 18, 2025Updated last year
- Repository for Multililngual Generation, RAG evaluations, and surrogate judge training for Arena RAG leaderboard (NAACL'25)β11Apr 10, 2025Updated last year
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"β72Dec 9, 2024Updated last year
- Complex Function Calling Benchmark.β182Jan 20, 2025Updated last year
- A tool to assist in the interpretation of learned features in sparse autoencoders (in particular the four SAE's trained by Joseph Bloom oβ¦β19Oct 4, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- AI conflict resolution framework designed to work alongside existing AI orchestration toolsβ22Dec 12, 2024Updated last year
- An agentic AI application that allows you to chat with your papers and gather also information from papers on ArXiv and on PubMedβ157May 18, 2025Updated last year
- UQ: Assessing Language Models on Unsolved Questionsβ30Aug 26, 2025Updated last year
- Structured Prompts Improve Evaluation of Language Modelsβ15Jun 5, 2026Updated 4 months ago
- Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".β698Jun 18, 2026Updated 4 months ago
- π² An agent for sourcing, curating, and scheduling social media posts with human-in-the-loop.β13Apr 18, 2025Updated last year
- KDD 2024 AQA competition 2nd place solutionβ12Jul 21, 2024Updated 2 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy modβ¦β15Apr 21, 2023Updated 3 years ago
- Curated AI skills, MCP servers, and workflow tools for content creators and knowledge workersβ14Oct 14, 2026Updated 2 weeks ago
- Open source password manager - Proton Pass β’ AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- β26Nov 5, 2021Updated 4 years ago
- The official repo for DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graphβ19Oct 13, 2024Updated 2 years ago
- SuperCLUE-Agent: εΊδΊδΈζεηδ»»ε‘ηAgentζΊθ½δ½ζ ΈεΏθ½εζ΅θ―εΊεβ96Nov 9, 2023Updated 2 years ago
- Retrieval-Augmented Generation battle!β66Apr 18, 2026Updated 6 months ago
- [NAACL 2025] Representing Rule-based Chatbots with Transformersβ23Feb 9, 2025Updated last year
- Language-specific AI writing pattern detectors for Claude Code, ChatGPT, Cursor and other AI tools. Statistically grounded β not translatβ¦β19Aug 5, 2026Updated 2 months ago
- Agentic system for real-world SQL databasesβ15Sep 21, 2026Updated last month
- python command-line Text-to-Speech (TTS) tool esp. for German, leveraging numerous endpoints like orpheus, piper, outetts, kokoro, csm, eβ¦β16Oct 1, 2026Updated last month
- β308Jul 1, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI β’ AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- fast trainer for educational purposesβ28Sep 12, 2026Updated last month
- A repository for my PyCon talk: "Building a personal assistant with Haystack and GPT: How to feed facts to large language models and reduβ¦β19Apr 16, 2023Updated 3 years ago
- β61May 3, 2026Updated 5 months ago
- Diagnose the performance of your RAGπ©Ίβ43Apr 5, 2025Updated last year
- FinanceRAG project by KAIST students. Advanced Retrieval-Augmented Generation (RAG) system designed for the financial domain.β18Feb 11, 2025Updated last year
- a single interface around speech-to-speech foundation modelsβ28Jun 27, 2025Updated last year
- β14Aug 16, 2025Updated last year