wschella / llm-reliability
Code for the paper "Larger and more instructable language models become less reliable"
☆29Updated 4 months ago
Alternatives and similar repositories for llm-reliability:
Users that are interested in llm-reliability are comparing it to the libraries listed below
- ☆19Updated 3 months ago
- ☆40Updated 7 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆69Updated 2 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- Aioli: A unified optimization framework for language model data mixing☆20Updated last month
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- A testbed for agents and environments that can automatically improve models through data generation.☆18Updated 2 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆39Updated 3 months ago
- On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆37Updated last month
- ☆15Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- ☆19Updated 4 months ago
- Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"☆52Updated 4 months ago
- ☆22Updated 2 weeks ago
- MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension☆39Updated 2 months ago
- CiteME is a benchmark designed to test the abilities of language models in finding papers that are cited in scientific texts.☆40Updated 3 months ago
- Agent framework for constructing language model agents and training on constructive tasks.☆63Updated this week
- LLM for Scientific Research Survey☆50Updated last month
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆35Updated this week
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆24Updated 2 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆31Updated last year
- Official implementation of "BERTs are Generative In-Context Learners"☆25Updated 8 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆74Updated 10 months ago
- This repository contains ScholarQABench data and evaluation pipeline.☆61Updated 2 weeks ago
- ☆14Updated 4 months ago
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆107Updated 9 months ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆53Updated last month
- ☆24Updated 3 months ago