Alternatives and similar repositories for RES-Q

Users that are interested in RES-Q are comparing it to the libraries listed below

• METR / public-tasks
  ☆118Updated 2 weeks ago
• google-deepmind / mishax
  ☆152Updated 5 months ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆133Updated last week
• princeton-pli / hal-harness
  ☆217Updated last week
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated last year
• METR / RE-Bench
  ☆133Updated 3 months ago
• METR / task-standard
  METR Task Standard
  ☆173Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 11 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆250Updated 11 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆82Updated last year
• google-deepmind / dangerous-capability-evaluations
  ☆65Updated this week
• PrimeIntellect-ai / community-environments
  Lightly-reviewed collection of community environments
  ☆210Updated last week
• PrimeIntellect-ai / genesys
  ☆137Updated 10 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆124Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆153Updated last year
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆116Updated last year
• javirandor / anthropic-tokenizer
  Approximation of the Claude 3 tokenizer by inspecting generation stream
  ☆150Updated last year
• poking-agents / modular-public
  ☆33Updated 8 months ago
• ScalingIntelligence / codemonkeys
  ☆59Updated last year
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆327Updated 3 months ago
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆66Updated 2 months ago
• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆100Updated 9 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆112Updated 9 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆246Updated last week
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆130Updated 4 months ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆46Updated 3 weeks ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆175Updated last year
• SalesforceAIResearch / LaTRO
  ☆123Updated 11 months ago