Alternatives and similar repositories for RES-Q

Users that are interested in RES-Q are comparing it to the libraries listed below

• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆133Updated last week
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• google-deepmind / mishax
  ☆152Updated 5 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆112Updated last year
• princeton-pli / hal-harness
  ☆223Updated this week
• METR / public-tasks
  ☆118Updated 2 weeks ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 11 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆328Updated 3 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆250Updated 11 months ago
• METR / RE-Bench
  ☆133Updated 3 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 11 months ago
• PrimeIntellect-ai / genesys
  ☆137Updated 10 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆153Updated last year
• poking-agents / modular-public
  ☆33Updated 8 months ago
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆82Updated last year
• arcee-ai / DAM
  ☆56Updated last year
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆66Updated 2 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆112Updated 9 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆90Updated 9 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆175Updated last year
• archiki / ADaPT
  Official code for the paper "ADaPT: As-Needed Decomposition and Planning with Language Models"
  ☆90Updated 2 years ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆79Updated last year
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆120Updated 2 years ago
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆116Updated last year
• haizelabs / bijection-learning
  ☆26Updated last year
• writer / writing-in-the-margins
  ☆120Updated last year
• ScalingIntelligence / codemonkeys
  ☆59Updated last year
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆235Updated 6 months ago