XinyuanWangCS / PromptAgent
This is the official repo for "PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization". PromptAgent is a novel automatic prompt optimization method that autonomously crafts prompts equivalent in quality to those handcrafted by experts, i.e., expert-level prompts.
☆204Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for PromptAgent
- [ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning☆178Updated last month
- FireAct: Toward Language Agent Fine-tuning☆255Updated last year
- ☆116Updated 5 months ago
- Generative Judge for Evaluating Alignment☆217Updated 10 months ago
- Implementation of "RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation".☆179Updated 5 months ago
- ☆217Updated 3 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents☆250Updated 6 months ago
- Reformatted Alignment☆112Updated last month
- [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆70Updated 7 months ago
- [ICML'24 Spotlight] "TravelPlanner: A Benchmark for Real-World Planning with Language Agents"☆247Updated 3 weeks ago
- Data and Code for Program of Thoughts (TMLR 2023)☆243Updated 6 months ago
- Codes for our paper "ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate"☆234Updated last month
- Codes for our paper "RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation"☆130Updated 3 months ago
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆156Updated 7 months ago
- 🤠 Agent-as-a-Judge and DevAI dataset☆192Updated this week
- KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents☆172Updated last month
- ☆287Updated 2 months ago
- Environments, tools, and benchmarks for general computer agents☆172Updated 3 weeks ago
- ☆171Updated 6 months ago
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆191Updated last month
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆114Updated 2 months ago
- This is the repository for the Tool Learning survey.☆252Updated 2 weeks ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆240Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆124Updated 3 weeks ago
- ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆62Updated 7 months ago
- [NeurIPS 2023] Codebase for the paper: "Guiding Large Language Models with Directional Stimulus Prompting"☆101Updated last year
- ☆295Updated 5 months ago
- YuLan-IR: Information Retrieval Boosted LMs☆215Updated 8 months ago
- [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton☆183Updated 7 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆38Updated 4 months ago