wschella / llm-reliabilityLinks
Code for the paper "Larger and more instructable language models become less reliable"
☆31Updated last year
Alternatives and similar repositories for llm-reliability
Users that are interested in llm-reliability are comparing it to the libraries listed below
Sorting:
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 8 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated 2 years ago
- CiteME is a benchmark designed to test the abilities of language models in finding papers that are cited in scientific texts.☆48Updated 11 months ago
- Discovering Data-driven Hypotheses in the Wild☆113Updated 4 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated 11 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated 11 months ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆42Updated 7 months ago
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆52Updated 2 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆37Updated last year
- Source code for the collaborative reasoner research project at Meta FAIR.☆102Updated 6 months ago
- Aioli: A unified optimization framework for language model data mixing☆27Updated 9 months ago
- Pre-trained Language Model for Scientific Text☆46Updated last year
- ☆48Updated 6 months ago
- Official Implementation of the Baby-AIGS system☆23Updated 10 months ago
- Official implementation of "BERTs are Generative In-Context Learners"☆32Updated 7 months ago
- Verifiers for LLM Reinforcement Learning☆76Updated 6 months ago
- Exploration of automated dataset selection approaches at large scales.☆47Updated 7 months ago
- [ICLR 2025]ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoning https://arxiv.org/abs/2501.06590☆72Updated 2 months ago
- ☆29Updated 2 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆96Updated last week
- A testbed for agents and environments that can automatically improve models through data generation.☆27Updated 7 months ago
- Official Implementation of UA^{2}-Agent and other baseline algorithms of "Towards Unified Alignment Between Agents, Humans, and Environme…☆19Updated 11 months ago
- ☆71Updated last week
- ☆61Updated 2 weeks ago
- On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆41Updated 3 months ago
- ☆25Updated 4 months ago
- Code release for "CURIE: Evaluating LLMs On Multitask Scientific Long Context Understanding and Reasoning", ICLR 2025☆28Updated 5 months ago
- UQ: Assessing Language Models on Unsolved Questions☆27Updated last month
- ☆128Updated last year