suzgunmirac / BIG-Bench-HardLinks
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
☆497Updated 11 months ago
Alternatives and similar repositories for BIG-Bench-Hard
Users that are interested in BIG-Bench-Hard are comparing it to the libraries listed below
Sorting:
- RewardBench: the first evaluation tool for reward models.☆604Updated last week
- ☆756Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆556Updated 6 months ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆546Updated last year
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆268Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆530Updated 4 months ago
- Data and Code for Program of Thoughts (TMLR 2023)☆276Updated last year
- A large-scale, fine-grained, diverse preference dataset (and models).☆341Updated last year
- Official implementation of paper "Cumulative Reasoning With Large Language Models" (https://arxiv.org/abs/2308.04371)☆294Updated 9 months ago
- Prod Env☆423Updated last year
- LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.☆703Updated 8 months ago
- Multi-agent Social Simulation + Efficient, Effective, and Stable alternative of RLHF. Code for the paper "Training Socially Aligned Langu…☆347Updated 2 years ago
- Generative Judge for Evaluating Alignment☆239Updated last year
- A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.☆367Updated last year
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆813Updated 11 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆456Updated 8 months ago
- This is a collection of research papers for Self-Correcting Large Language Models with Automated Feedback.☆531Updated 7 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆379Updated 11 months ago
- This repository contains a collection of papers and resources on Reasoning in Large Language Models.☆564Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆252Updated last year
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆325Updated last year
- ☆331Updated 2 weeks ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆264Updated 9 months ago
- Code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning" [ICLR 2024]☆375Updated 9 months ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆489Updated 8 months ago
- ☆276Updated 5 months ago
- An extensible benchmark for evaluating large language models on planning☆382Updated last month
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆563Updated last year
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆336Updated 8 months ago
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆897Updated 4 months ago