uiuc-kang-lab / agentic-benchmarksLinks
☆45Updated 2 months ago
Alternatives and similar repositories for agentic-benchmarks
Users that are interested in agentic-benchmarks are comparing it to the libraries listed below
Sorting:
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆64Updated 10 months ago
- ☆61Updated 2 weeks ago
- Verifiers for LLM Reinforcement Learning☆74Updated 5 months ago
- ☆80Updated this week
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 8 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated 11 months ago
- ☆55Updated 11 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 3 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- LLM reads a paper and produce a working prototype☆57Updated 6 months ago
- ☆29Updated 2 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆44Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 5 months ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆27Updated 10 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- ☆78Updated 3 weeks ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- ☆25Updated 4 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 4 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆102Updated 2 months ago
- Aioli: A unified optimization framework for language model data mixing☆27Updated 8 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 8 months ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated 2 years ago
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆28Updated 6 months ago
- Open Source Replication of Anthropic's Alignment Faking Paper☆52Updated 6 months ago
- Small, simple agent task environments for training and evaluation☆18Updated 11 months ago
- Tree prompting: easy-to-use scikit-learn interface for improved prompting.☆40Updated last year
- ☆41Updated last year
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated 3 weeks ago
- ☆28Updated 6 months ago