Alternatives and similar repositories for LOOP-Evals

Users that are interested in LOOP-Evals are comparing it to the libraries listed below

• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated last year
• agemoai / arcsolver
  A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.
  ☆23Updated 8 months ago
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆41Updated last year
• moirage / alignment-research-dataset
  A dataset of alignment research and code to reproduce it
  ☆77Updated 2 years ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 8 months ago
• curai / curai-research
  ☆94Updated 9 months ago
• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆16Updated 4 years ago
• oughtinc / primer
  Factored Cognition Primer: How to write compositional language model programs
  ☆49Updated 2 years ago
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆64Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated 2 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 3 years ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• EleutherAI / semantic-memorization
  ☆44Updated 10 months ago
• DAIOS-AI / mindscript
  A programming language for formal/informal computation.
  ☆41Updated last month
• epfl-dlab / GPTurk
  ☆29Updated 2 years ago
• boschresearch / switchprompt
  Resources related to EACL 2023 paper "SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domain…
  ☆52Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated last year
• joshuacnf / Ctrl-G
  ☆100Updated 8 months ago
• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated last year
• weaviate / biggraph-wikidata-search-with-weaviate
  Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine
  ☆31Updated 3 years ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆55Updated 5 months ago
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• NousResearch / StripedHyenaTrainer
  ☆62Updated last year
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆42Updated 6 months ago
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆33Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated last year
• qrdlgit / graph-of-thoughts
  Based on the tree of thoughts paper
  ☆48Updated 2 years ago
• kanishkg / synchromesh
  Get language models to generate responses in a specific format reliably. Open source implementation of Synchromesh: Reliable code generat…
  ☆29Updated last year
• rajammanabrolu / Q-BERT
  Agents that build knowledge graphs and explore textual worlds by asking questions
  ☆79Updated 2 years ago