matthewrenze / jhu-llm-temperature
The Effect of Sampling Temperature on Problem Solving in Large Language Models
☆15Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for jhu-llm-temperature
- Scalable Meta-Evaluation of LLMs as Evaluators☆41Updated 9 months ago
- ☆33Updated last month
- Retrieval Augmented Generation Generalized Evaluation Dataset☆51Updated this week
- Code for "Democratizing Reasoning Ability: Tailored Learning from Large Language Model", EMNLP 2023☆31Updated 11 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- ☆56Updated 9 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆122Updated 8 months ago
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆111Updated 2 months ago
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆91Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆124Updated 3 weeks ago
- ☆112Updated last month
- Critique-out-Loud Reward Models☆38Updated last month
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages☆37Updated last month
- ☆19Updated 3 weeks ago
- ☆37Updated last year
- The codebase for our ACL2023 paper: Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learni…☆27Updated last year
- Code for paper Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding☆46Updated 5 months ago
- Retrieval-Augmented Generation battle!☆45Updated last week
- Token-level Reference-free Hallucination Detection☆93Updated last year
- Official implementation of "OffsetBias: Leveraging Debiased Data for Tuning Evaluators"☆14Updated 2 months ago
- ☆28Updated last month
- ☆22Updated 2 weeks ago
- ☆22Updated last month
- [EACL 2023] CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification☆38Updated last year
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆28Updated 5 months ago
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆52Updated 2 months ago
- Small and Efficient Mathematical Reasoning LLMs☆71Updated 9 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆73Updated 3 months ago
- Benchmarking library for RAG☆123Updated this week
- Code for Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks☆47Updated 7 months ago