Junjie-Ye / RoTBench
RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning
☆12Updated 5 months ago
Related projects: ⓘ
- ☆16Updated 6 months ago
- Syntax Error-Free and Generalizable Tool Use for LLMs via Finite-State Decoding☆28Updated 7 months ago
- ☆12Updated last month
- ☆20Updated 4 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆54Updated 6 months ago
- Evaluate the Quality of Critique☆35Updated 3 months ago
- ☆31Updated 5 months ago
- Source code for the paper "Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data"☆20Updated 6 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆45Updated 6 months ago
- EMNLP 2023 Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts☆23Updated 10 months ago
- ☆39Updated 9 months ago
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆49Updated 2 weeks ago
- ☆80Updated 9 months ago
- Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"☆42Updated 3 months ago
- GPT as Human☆17Updated 8 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆28Updated last month
- The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agen…☆20Updated 6 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆38Updated 2 months ago
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆20Updated 6 months ago
- ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆63Updated 5 months ago
- Supporting code for ReCEval paper☆26Updated this week
- "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)☆13Updated last year
- ☆32Updated 8 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆62Updated 3 months ago
- Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process☆17Updated last month
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆51Updated last year
- ☆26Updated last year
- [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback☆35Updated 6 months ago
- ☆23Updated 2 months ago
- This is the official project of paper: Compress to Impress: Unleashing the Potential of Compressive Memory in Real-World Long-Term Conver…☆14Updated 2 months ago