strangeloopcanon / LOOP-EvalsLinks
Logical Operations On Puzzles: Simple Iterative Reasoning Tests for LLMs first through wordgrids
☆17Updated 6 months ago
Alternatives and similar repositories for LOOP-Evals
Users that are interested in LOOP-Evals are comparing it to the libraries listed below
Sorting:
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆73Updated last year
- A dataset of alignment research and code to reproduce it☆77Updated 2 years ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 7 months ago
- ☆89Updated 7 months ago
- A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.☆22Updated 7 months ago
- A programming language for formal/informal computation.☆41Updated 3 weeks ago
- Understanding how features learned by neural networks evolve throughout training☆36Updated 10 months ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- Based on the tree of thoughts paper☆48Updated last year
- One stop shop for all things carp☆59Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆47Updated 2 years ago
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆64Updated 2 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆51Updated 4 months ago
- Functional Benchmarks and the Reasoning Gap☆88Updated 10 months ago
- ☆14Updated last year
- ☆22Updated 2 years ago
- ☆44Updated 9 months ago
- Factored Cognition Primer: How to write compositional language model programs☆49Updated 2 years ago
- Finding semantically meaningful and accurate prompts.☆47Updated last year
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated 2 years ago
- LILO: Library Induction with Language Observations☆88Updated last year
- The data and implementation for the experiments in the paper "Flows: Building Blocks of Reasoning and Collaborating AI".☆31Updated last year
- Track the progress of LLM context utilisation☆55Updated 4 months ago
- Resources related to EACL 2023 paper "SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domain…☆52Updated 2 years ago
- ☆69Updated last year
- assign color hues to a collection of text fragments based on embeddings☆20Updated last year
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆18Updated last year
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆70Updated 2 years ago
- Google Research☆45Updated 2 years ago