strangeloopcanon / LOOP-EvalsLinks
Logical Operations On Puzzles: Simple Iterative Reasoning Tests for LLMs first through wordgrids
☆17Updated 3 months ago
Alternatives and similar repositories for LOOP-Evals
Users that are interested in LOOP-Evals are comparing it to the libraries listed below
Sorting:
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆72Updated 10 months ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆40Updated 2 months ago
- Factored Cognition Primer: How to write compositional language model programs☆49Updated 2 years ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 4 months ago
- One stop shop for all things carp☆59Updated 2 years ago
- A dataset of alignment research and code to reproduce it☆77Updated last year
- ☆14Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆26Updated 5 months ago
- PyTorch implementation for MRL☆18Updated last year
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- Efficiently computing & storing token n-grams from large corpora☆23Updated 8 months ago
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆65Updated last year
- Embedding Recycling for Language models☆38Updated last year
- ☆44Updated 6 months ago
- ☆18Updated last year
- ☆21Updated 3 weeks ago
- ☆29Updated last year
- The codebase for our ACL2023 paper: Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learni…☆29Updated last year
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆16Updated last year
- Google Research☆46Updated 2 years ago
- Minimum Description Length probing for neural network representations☆19Updated 4 months ago
- ☆19Updated 3 years ago
- ☆35Updated 2 years ago
- Based on the tree of thoughts paper☆48Updated last year
- Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"☆19Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Understanding how features learned by neural networks evolve throughout training☆34Updated 7 months ago
- ☆26Updated 2 years ago