snap-stanford / MLAgentBench
☆224Updated 3 months ago
Related projects: ⓘ
- An Analytical Evaluation Board of Multi-turn LLM Agents☆227Updated 4 months ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆182Updated 4 months ago
- RewardBench: the first evaluation tool for reward models.☆352Updated last week
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆218Updated 5 months ago
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆151Updated 4 months ago
- ICML 2024: Improving Factuality and Reasoning in Language Models through Multiagent Debate☆332Updated 11 months ago
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆260Updated last year
- An extensible benchmark for evaluating large language models on planning☆248Updated 3 months ago
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark☆139Updated 5 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆182Updated last month
- [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents☆256Updated 2 weeks ago
- Code and Data for Tau-Bench☆91Updated this week
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆209Updated 8 months ago
- A curated collection of LLM reasoning and planning resources, including key papers, limitations, benchmarks, and additional learning mate…☆148Updated 3 weeks ago
- ☆105Updated this week
- Source code for the paper "Active Prompting with Chain-of-Thought for Large Language Models"☆213Updated 4 months ago
- A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆106Updated 5 months ago
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆207Updated last year
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆230Updated 5 months ago
- augmented LLM with self reflection☆80Updated 10 months ago
- Chain-of-Hindsight, A Scalable RLHF Method☆213Updated 11 months ago
- Code for the paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆140Updated 3 months ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆124Updated last month
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆134Updated 6 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆175Updated 3 months ago
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆109Updated 11 months ago
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆96Updated 4 months ago
- [ACL 2024] Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View☆89Updated 4 months ago
- [NeurIPS '23 Spotlight] Thought Cloning: Learning to Think while Acting by Imitating Human Thinking☆249Updated 2 months ago
- Reasoning with Language Model is Planning with World Model☆137Updated last year