uiuc-kang-lab / agentic-benchmarksLinks
☆43Updated last month
Alternatives and similar repositories for agentic-benchmarks
Users that are interested in agentic-benchmarks are comparing it to the libraries listed below
Sorting:
- ☆54Updated 10 months ago
- Verifiers for LLM Reinforcement Learning☆72Updated 5 months ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆27Updated 9 months ago
- ☆29Updated last month
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 7 months ago
- ☆73Updated 2 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆62Updated 9 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 2 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 7 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated last week
- Aioli: A unified optimization framework for language model data mixing☆27Updated 8 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 5 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 4 months ago
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆35Updated 11 months ago
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆28Updated 5 months ago
- ☆41Updated last year
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆50Updated 10 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- ☆81Updated 2 weeks ago
- ☆39Updated last year
- Exploring limitations of LLM-as-a-judge☆18Updated last year
- ☆52Updated last year
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆102Updated last month
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆43Updated last year
- Python package for generating datasets to evaluate reasoning and retrieval of large language models☆19Updated last week
- ☆67Updated 5 months ago
- CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)☆72Updated last year
- Small, simple agent task environments for training and evaluation☆18Updated 10 months ago