gydpku / PPTC
PPTC Benchmark: Evaluating Large Language Models for PowerPoint Task Completion
☆53Updated last year
Alternatives and similar repositories for PPTC:
Users that are interested in PPTC are comparing it to the libraries listed below
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆65Updated 5 months ago
- ☆36Updated 8 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year
- Feeling confused about super alignment? Here is a reading list☆42Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆47Updated 4 months ago
- Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment☆75Updated 10 months ago
- ☆49Updated last year
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆85Updated last year
- Reformatted Alignment☆115Updated 7 months ago
- Code for ACL2023 paper: Pre-Training to Learn in Context☆108Updated 9 months ago
- Do Large Language Models Know What They Don’t Know?☆94Updated 6 months ago
- Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"☆55Updated 11 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆48Updated 10 months ago
- Self-Alignment with Principle-Following Reward Models☆161Updated this week
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆101Updated 2 months ago
- [ICLR24] The open-source repo of THU-KEG's KoLA benchmark.☆50Updated last year
- Towards Systematic Measurement for Long Text Quality☆34Updated 8 months ago
- [EMNLP 2023 Demo] CLEVA: Chinese Language Models EVAluation Platform☆62Updated last month
- A framework for evolving and testing question-answering datasets with various models.☆14Updated last year
- ☆98Updated 7 months ago
- [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback☆41Updated last year
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated last year
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073☆28Updated 10 months ago
- Code and data for "Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation" (EMNLP 2023)☆63Updated last year
- [NAACL 2024] Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models☆85Updated last year
- MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following☆16Updated 6 months ago
- Code implementation of synthetic continued pretraining☆107Updated 4 months ago
- ☆24Updated 10 months ago
- [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs☆39Updated 5 months ago
- Syntax Error-Free and Generalizable Tool Use for LLMs via Finite-State Decoding☆27Updated last year