strangeloopcanon / LOOP-EvalsLinks
Logical Operations On Puzzles: Simple Iterative Reasoning Tests for LLMs first through wordgrids
☆18Updated 11 months ago
Alternatives and similar repositories for LOOP-Evals
Users that are interested in LOOP-Evals are comparing it to the libraries listed below
Sorting:
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆73Updated last year
- A library for squeakily cleaning and filtering language datasets.☆49Updated 2 years ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated last year
- One stop shop for all things carp☆59Updated 3 years ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆32Updated 2 years ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated 2 years ago
- ☆44Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆43Updated 2 years ago
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆66Updated 2 years ago
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 3 years ago
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- Based on the tree of thoughts paper☆48Updated 2 years ago
- Embedding Recycling for Language models☆38Updated 2 years ago
- Experiments for efforts to train a new and improved t5☆76Updated last year
- ☆95Updated last year
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated 2 years ago
- A dataset of alignment research and code to reproduce it☆78Updated 2 years ago
- ☆22Updated 2 years ago
- Resources related to EACL 2023 paper "SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domain…☆52Updated 2 years ago
- ☆62Updated 2 years ago
- ☆29Updated 2 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 4 years ago
- Code repository for the c-BTM paper☆108Updated 2 years ago
- A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.☆25Updated last year
- ☆44Updated 3 years ago
- Google Research☆46Updated 3 years ago
- Agents that build knowledge graphs and explore textual worlds by asking questions☆79Updated 2 years ago
- Multi-Domain Expert Learning☆67Updated last year