Alternatives and similar repositories for LOOP-Evals:

Users that are interested in LOOP-Evals are comparing it to the libraries listed below

• weaviate / biggraph-wikidata-search-with-weaviate
  Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine
  ☆31Updated 3 years ago
• oughtinc / primer
  Factored Cognition Primer: How to write compositional language model programs
  ☆48Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• allenai / everyday-things
  ☆17Updated last year
• thoppe / The-Pile-PhilPapers
  Download, parse, and filter data from Phil Papers. Data-ready for The-Pile.
  ☆15Updated last year
• fbarez / neuroplasticity
  ☆14Updated last year
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 3 months ago
• collinskatie / structured_flexible_and_robust
  ☆13Updated last year
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated 9 months ago
• Avmb / inverse_scaling_prize_code_identifier_swap
  Submission to the inverse scaling prize
  ☆23Updated last year
• benpry / chain-of-thought-metaphor
  This repo contains code for the paper "Psychologically-informed chain-of-thought prompts for metaphor understanding in large language mod…
  ☆14Updated 2 years ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 weeks ago
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆34Updated 6 months ago
• cognitiveailab / BYTESIZED32
  Byte-sized text games for code generation tasks on virtual environments
  ☆19Updated 9 months ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆33Updated 11 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• jmerullo / lm_vector_arithmetic
  ☆34Updated last year
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated 2 years ago
• DAIOS-AI / mindscript
  A programming language for formal/informal computation.
  ☆41Updated 2 weeks ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated 11 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 5 months ago
• agemoai / arcsolver
  A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.
  ☆21Updated 4 months ago
• stanford-futuredata / Baleen
  Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrieval (NeurIPS'21)
  ☆44Updated 3 years ago
• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆16Updated last year
• qrdlgit / graph-of-thoughts
  Based on the tree of thoughts paper
  ☆48Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• srush / text2table
  ☆31Updated 2 years ago
• HazyResearch / ludwig-benchmarking-toolkit
  Ludwig benchmark
  ☆20Updated 3 years ago
• luohongyin / LangCode
  LangCode - Improving alignment and reasoning of large language models (LLMs) with natural language embedded program (NLEP).
  ☆42Updated last year