BatsResearch / planetarium
Dataset and benchmark for assessing LLMs in translating natural language descriptions of planning problems into PDDL
☆42Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for planetarium
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆56Updated 2 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆84Updated 2 months ago
- Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22☆64Updated 2 years ago
- Super fast implementations of common benchmark text world games☆43Updated this week
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆38Updated 2 weeks ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆61Updated 4 months ago
- ☆68Updated 2 months ago
- LLM Dynamic Planner - Combining LLM with PDDL Planners to solve an embodied task☆36Updated last month
- ☆50Updated last month
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 9 months ago
- ☆99Updated 3 months ago
- A repository for transformer critique learning and generation☆85Updated 11 months ago
- ☆21Updated last month
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆48Updated 7 months ago
- Discovering Data-driven Hypotheses in the Wild☆39Updated 2 weeks ago
- ☆73Updated 4 months ago
- ☆28Updated 7 months ago
- ☆74Updated last week
- ☆18Updated 5 months ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆34Updated 7 months ago
- Code and Data for the NAACL 24 paper: MacGyver: Are Large Language Models Creative Problem Solvers?☆22Updated 7 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆13Updated last week
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆17Updated 10 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆62Updated last year
- Repository for Skill Set Optimization☆12Updated 3 months ago
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆68Updated last year
- We develop benchmarks and analysis tools to evaluate the causal reasoning abilities of LLMs.☆96Updated 5 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆41Updated 9 months ago
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆106Updated 2 weeks ago
- Inspecting and Editing Knowledge Representations in Language Models☆107Updated last year