strangeloopcanon / LOOP-EvalsLinks
Logical Operations On Puzzles: Simple Iterative Reasoning Tests for LLMs first through wordgrids
☆16Updated 7 months ago
Alternatives and similar repositories for LOOP-Evals
Users that are interested in LOOP-Evals are comparing it to the libraries listed below
Sorting:
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆72Updated last year
- A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.☆23Updated 9 months ago
- A library for squeakily cleaning and filtering language datasets.☆46Updated 2 years ago
- ☆44Updated 10 months ago
- A dataset of alignment research and code to reproduce it☆77Updated 2 years ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆41Updated last year
- ☆22Updated 2 years ago
- Based on the tree of thoughts paper☆48Updated 2 years ago
- ☆69Updated last year
- ☆95Updated 9 months ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated 2 years ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 9 months ago
- Factored Cognition Primer: How to write compositional language model programs☆49Updated 2 years ago
- ☆102Updated 9 months ago
- Understanding how features learned by neural networks evolve throughout training☆39Updated 11 months ago
- One stop shop for all things carp☆59Updated 3 years ago
- ☆27Updated 2 years ago
- Google Research☆46Updated 2 years ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆42Updated 6 months ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- Resources related to EACL 2023 paper "SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domain…☆52Updated 2 years ago
- ☆14Updated last year
- Multi-Domain Expert Learning☆66Updated last year
- assign color hues to a collection of text fragments based on embeddings☆20Updated last year
- Advanced Reasoning Benchmark Dataset for LLMs☆46Updated last year
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆55Updated last week
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated last year
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆33Updated last year
- ☆36Updated 2 years ago
- ☆97Updated 2 months ago