Alternatives and similar repositories for LOOP-Evals

Users that are interested in LOOP-Evals are comparing it to the libraries listed below

• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆40Updated last year
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated 11 months ago
• curai / curai-research
  ☆94Updated 7 months ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 6 months ago
• jmerullo / lm_vector_arithmetic
  ☆35Updated 2 years ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 4 months ago
• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆36Updated 8 months ago
• epfl-dlab / GPTurk
  ☆29Updated last year
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated last year
• qrdlgit / graph-of-thoughts
  Based on the tree of thoughts paper
  ☆48Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• moirage / alignment-research-dataset
  A dataset of alignment research and code to reproduce it
  ☆77Updated 2 years ago
• EleutherAI / semantic-memorization
  ☆44Updated 8 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated 2 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• Avmb / inverse_scaling_prize_code_identifier_swap
  Submission to the inverse scaling prize
  ☆23Updated last year
• HazyResearch / ludwig-benchmarking-toolkit
  Ludwig benchmark
  ☆20Updated 3 years ago
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆51Updated 3 years ago
• harish-kamath / rqae
  Residual Quantization Autoencoder, used for interpreting LLMs
  ☆12Updated 6 months ago
• weaviate / biggraph-wikidata-search-with-weaviate
  Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine
  ☆31Updated 3 years ago
• agemoai / arcsolver
  A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.
  ☆22Updated 6 months ago
• SALT-NLP / Bound-Cap-LLM
  Source codes for the paper "Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints"
  ☆27Updated 2 years ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 9 months ago
• hgaurav2k / JEEBench
  Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Langu…
  ☆39Updated last year
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• zhangir-azerbayev / proof-pile
  Scripts for downloading and pre-processing the `proof-pile`, a high quality dataset of mathematical text and code.
  ☆20Updated 2 years ago
• joshuacnf / Ctrl-G
  ☆87Updated 6 months ago
• oughtinc / primer
  Factored Cognition Primer: How to write compositional language model programs
  ☆49Updated 2 years ago