Alternatives and similar repositories for invariant:

Users that are interested in invariant are comparing it to the libraries listed below

• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆175Updated last month
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆30Updated this week
• haizelabs / verdict
  Scaling inference-time compute for LLM-as-a-judge, automated evaluations, guardrails, and reinforcement learning.
  ☆189Updated last week
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated last month
• aorwall / moatless-tools
  ☆367Updated last month
• ozyyshr / RepoGraph
  Enhancing AI Software Engineering with Repository-level Code Graph
  ☆146Updated 2 months ago
• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆89Updated 9 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆96Updated last year
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆112Updated this week
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆155Updated 2 weeks ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆129Updated last week
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆83Updated this week
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆98Updated 4 months ago
• r2e-project / r2e
  r2e: turn any github repository into a programming agent environment
  ☆105Updated 3 weeks ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆288Updated 4 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆108Updated last year
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆210Updated 10 months ago
• hwchase17 / langfuzz
  ☆71Updated 5 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆75Updated 5 months ago
• haizelabs / thorn-in-haizestack
  Thorn in a HaizeStack test for evaluating long-context adversarial robustness.
  ☆26Updated 7 months ago
• microsoft / TaskTracker
  TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…
  ☆50Updated 2 weeks ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆165Updated 2 weeks ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆97Updated this week
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆272Updated last week
• PrimeIntellect-ai / genesys
  ☆106Updated this week
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆131Updated last year
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆139Updated 2 weeks ago
• invariantlabs-ai / playwright-computer-use
  Let Claude control a web browser on your machine.
  ☆17Updated 3 weeks ago
• andyzorigin / cybench
  ☆86Updated 3 weeks ago
• aorwall / SWE-bench-docker
  ☆87Updated 8 months ago