Alternatives and similar repositories for RES-Q

Users that are interested in RES-Q are comparing it to the libraries listed below

• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆99Updated this week
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 11 months ago
• google-deepmind / mishax
  ☆134Updated 3 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆251Updated this week
• princeton-pli / hal-harness
  ☆97Updated 2 weeks ago
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆62Updated 8 months ago
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 5 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 4 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆224Updated this week
• METR / public-tasks
  ☆99Updated 4 months ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 2 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆190Updated last year
• METR / RE-Bench
  ☆92Updated 2 months ago
• facebookresearch / ExploreToM
  Code for ExploreTom
  ☆84Updated 3 weeks ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆99Updated 4 months ago
• QuixiAI / spectrum
  ☆128Updated 3 months ago
• PrimeIntellect-ai / genesys
  ☆129Updated 3 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆149Updated 5 months ago
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆222Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆267Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 9 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆109Updated last year
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 6 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆154Updated 2 months ago
• javirandor / anthropic-tokenizer
  Approximation of the Claude 3 tokenizer by inspecting generation stream
  ☆131Updated 11 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆107Updated 2 months ago
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆159Updated 2 months ago
• SalesforceAIResearch / LaTRO
  ☆117Updated 4 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆202Updated 5 months ago
• emergent-misalignment / emergent-misalignment
  ☆171Updated 4 months ago