epfl-dlab / forc
Framework for Cost-Effective Language Model Choice
☆13Updated 9 months ago
Related projects: ⓘ
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆28Updated last month
- This is the implementation for the paper "LARGE LANGUAGE MODEL CASCADES WITH MIX- TURE OF THOUGHT REPRESENTATIONS FOR COST- EFFICIENT REA…☆17Updated 3 months ago
- Repository for paper Tools Are Instrumental for Language Agents in Complex Environments☆32Updated 8 months ago
- Evaluate the Quality of Critique☆35Updated 3 months ago
- ☆16Updated 3 months ago
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆37Updated 2 months ago
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆41Updated last month
- Official codebase for permutation self-consistency.☆16Updated 7 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆45Updated 6 months ago
- Benchmarking Benchmark Leakage in Large Language Models☆39Updated 4 months ago
- ☆80Updated 9 months ago
- Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator support…☆34Updated last year
- This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".☆22Updated last month
- ☆20Updated 4 months ago
- Code/data for MARG (multi-agent review generation)☆24Updated 4 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆39Updated 7 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆29Updated 7 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆62Updated 3 months ago
- This is official project in our paper: Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers☆20Updated 8 months ago
- A Retrieval Benchmark for Scientific Literature Search☆53Updated 2 months ago
- ☆20Updated last week
- Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"☆42Updated 3 months ago
- Code for paper - On Diversified Preferences of Large Language Model Alignment☆14Updated last month
- ☆52Updated 7 months ago
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆49Updated 2 weeks ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 8 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆63Updated 5 months ago
- ☆16Updated 6 months ago
- Official implementation for <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>, accepted by ACL 2024.☆32Updated 3 months ago
- ☆13Updated last week