TheDuckAI / arbLinks
Advanced Reasoning Benchmark Dataset for LLMs
☆46Updated last year
Alternatives and similar repositories for arb
Users that are interested in arb are comparing it to the libraries listed below
Sorting:
- Mixing Language Models with Self-Verification and Meta-Verification☆109Updated 11 months ago
- Based on the tree of thoughts paper☆48Updated 2 years ago
- Aioli: A unified optimization framework for language model data mixing☆28Updated 9 months ago
- Code repository for the c-BTM paper☆107Updated 2 years ago
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆39Updated last year
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆66Updated 2 years ago
- ☆55Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆43Updated last month
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆99Updated 2 years ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Open Implementations of LLM Analyses☆107Updated last year
- A repository for transformer critique learning and generation☆89Updated last year
- Pre-training code for CrystalCoder 7B LLM☆55Updated last year
- ☆44Updated 11 months ago
- ☆129Updated last year
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆60Updated last year
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆107Updated 2 years ago
- ☆80Updated 7 months ago
- Small and Efficient Mathematical Reasoning LLMs☆72Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated 2 years ago
- Evaluating LLMs with CommonGen-Lite☆91Updated last year
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆56Updated 3 weeks ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆44Updated last year
- [NAACL 2024] Struc-Bench: Are Large Language Models Good at Generating Complex Structured Tabular Data? https://aclanthology.org/2024.naa…☆55Updated 3 months ago
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆70Updated 3 years ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆48Updated last year
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Updated 2 years ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆49Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year