Alternatives and similar repositories for invariant:

Users that are interested in invariant are comparing it to the libraries listed below

• haizelabs / verdict
  Verdict is a library for scaling judge-time compute.
  ☆195Updated 3 weeks ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆181Updated 2 months ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆34Updated this week
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 2 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆90Updated last month
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆149Updated last week
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆89Updated this week
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆109Updated last year
• aorwall / moatless-tools
  ☆385Updated this week
• andyzorigin / cybench
  ☆92Updated last month
• invariantlabs-ai / playwright-computer-use
  Let Claude control a web browser on your machine.
  ☆24Updated last month
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆276Updated last week
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆143Updated last week
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym
  ☆430Updated 2 weeks ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆166Updated 2 weeks ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆100Updated last year
• ozyyshr / RepoGraph
  Enhancing AI Software Engineering with Repository-level Code Graph
  ☆153Updated 2 weeks ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆114Updated this week
• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆89Updated this week
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆166Updated last week
• google-deepmind / mishax
  ☆128Updated 2 weeks ago
• haizelabs / redteaming-resistance-benchmark
  ☆42Updated 8 months ago
• haizelabs / bijection-learning
  ☆22Updated 5 months ago
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆124Updated 2 weeks ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆85Updated 6 months ago
• normal-computing / branches
  Prototype advanced LLM algorithms for reasoning and planning.
  ☆96Updated 8 months ago
• PrimeIntellect-ai / genesys
  ☆120Updated 3 weeks ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆257Updated 2 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆179Updated last year
• METR / task-standard
  METR Task Standard
  ☆147Updated 2 months ago