MetaCopilot / dseval
☆24Updated 7 months ago
Alternatives and similar repositories for dseval:
Users that are interested in dseval are comparing it to the libraries listed below
- Companion code to https://arxiv.org/abs/2402.15491☆16Updated 9 months ago
- [EMNLP'24 (Main)] DRPO(Dynamic Rewarding with Prompt Optimization) is a tuning-free approach for self-alignment. DRPO leverages a search-…☆20Updated 2 months ago
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆68Updated last month
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated 11 months ago
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆41Updated last week
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆44Updated last month
- Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"☆65Updated 5 months ago
- The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agen…☆23Updated 10 months ago
- Trending projects & awesome papers about data-centric llm studies.☆33Updated last week
- Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"☆32Updated 3 months ago
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"☆54Updated last year
- This is the implementation for the paper "LARGE LANGUAGE MODEL CASCADES WITH MIX- TURE OF THOUGHT REPRESENTATIONS FOR COST- EFFICIENT REA…☆19Updated 7 months ago
- This is the repository for paper "CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models"☆23Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated 11 months ago
- ☆30Updated last year
- A framework for evolving and testing question-answering datasets with various models.☆13Updated 11 months ago
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated last year
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆110Updated 7 months ago
- NaturalCodeBench (Findings of ACL 2024)☆61Updated 3 months ago
- Towards Systematic Measurement for Long Text Quality☆31Updated 4 months ago
- Repository for Decomposed Prompting☆84Updated last year
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆64Updated last month
- ☆14Updated 7 months ago
- ☆93Updated last year
- [ACL 2022] A hierarchical table dataset for question answering and data-to-text generation.☆77Updated 2 months ago
- Evaluate the Quality of Critique☆35Updated 7 months ago
- This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.☆70Updated 2 years ago
- Code implementation of synthetic continued pretraining☆82Updated 3 weeks ago
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆24Updated last year
- Complexity Based Prompting for Multi-Step Reasoning☆16Updated last year