☆52May 4, 2026Updated 6 months ago
Alternatives and similar repositories for AlphaEval
Users that are interested in AlphaEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Mar 15, 2026Updated 7 months ago
- ☆12May 26, 2025Updated last year
- [ACL 2026] This is the repo of Data Darwinism.☆28Apr 16, 2026Updated 6 months ago
- [ACL2026 Main] AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts☆105Jan 23, 2026Updated 9 months ago
- [ICLR 2026]InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Research☆17Nov 4, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [EMNLP 2022] TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data☆17May 17, 2023Updated 3 years ago
- ☆22Jun 7, 2023Updated 3 years ago
- Official Repository for our paper: AdaPlanBench: Evaluating Adaptive Planning in Large Language Model Agents under World and User Constra…☆28Sep 19, 2026Updated last month
- ☆21Jul 26, 2026Updated 3 months ago
- ☆17Sep 24, 2026Updated last month
- ☆29Oct 12, 2026Updated last month
- [ICML 2026 Oral] Agent-native Mid-training for Software Engineering☆86Jun 7, 2026Updated 5 months ago
- ☆38Oct 27, 2026Updated 2 weeks ago
- Finance and Accounting Workflow Benchmark☆16Apr 13, 2026Updated 6 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [ACL 2026 Findings] Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generati…☆15Apr 23, 2026Updated 6 months ago
- A cross-platform Plain Craft Launcher☆27Updated this week
- An SRL-based approach to factuality estimation for text summarization☆10May 24, 2023Updated 3 years ago
- A library for data streaming and augmentation☆22May 5, 2025Updated last year
- ☆12Jun 18, 2024Updated 2 years ago
- Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.☆11Oct 20, 2026Updated 3 weeks ago
- ☆10Feb 24, 2026Updated 8 months ago
- The Maximo MCP Server is a Model Context Protocol server that connects AI assistants (like Antigravity, Cursor, or VS Code Copilot) direc…☆11Sep 17, 2026Updated last month
- EnterpriseBench is a comprehensive framework designed to evaluate Large Language Model (LLM) agents within realistic enterprise environme…☆14Sep 15, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Memory Transfer Learning: How Memories are Transferred Across Domains in Coding Agents☆31Apr 16, 2026Updated 6 months ago
- A slightly cleaned up version of the scripts & data for the CoNLL 2012 Coreference task.☆14May 2, 2022Updated 4 years ago
- Experiments on using ChatGPT for failure mode classification☆12Sep 20, 2023Updated 3 years ago
- Findings in ACL 2023☆10Dec 5, 2023Updated 2 years ago
- OccuBench: Evaluating AI Agents on Real-World Professional Tasks via Language World Models☆22Apr 14, 2026Updated 6 months ago
- Official implementation for "MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models"☆20Oct 26, 2024Updated 2 years ago
- NUEQ-ACM2021年度预备队题解仓库☆23Mar 27, 2022Updated 4 years ago
- Official implementation for the paper "Video-Based Reward Modeling for Computer-Use Agents"☆18Mar 14, 2026Updated 7 months ago
- Some of utilities/scripts I created/borrowed to help me be at ease☆16Apr 14, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This is an AAAI-2026 conference paper repo.☆18Mar 1, 2026Updated 8 months ago
- ☆23Dec 11, 2025Updated 11 months ago
- Benchmarking Benchmark Leakage in Large Language Models☆61May 20, 2024Updated 2 years ago
- Text-to-SQL Evaluation Toolkit: A modular framework for evaluating natural language to SQL systems☆19Nov 5, 2026Updated last week
- The Walnut Plan☆11Oct 10, 2024Updated 2 years ago
- ☆10May 23, 2025Updated last year
- Awesome list of general agent benchmarks☆14May 9, 2025Updated last year
Are these results useful?