invariantlabs-ai / invariant

Related projects ⓘ

Alternatives and complementary repositories for invariant

• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆142Updated 7 months ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆63Updated this week
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆48Updated 3 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆107Updated 8 months ago
• andyzorigin / cybench
  ☆63Updated this week
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆220Updated 2 months ago
• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆86Updated 5 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆84Updated 8 months ago
• swe-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆103Updated this week
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆154Updated last month
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆97Updated 11 months ago
• google-deepmind / mishax
  ☆101Updated 3 months ago
• haizelabs / thorn-in-haizestack
  Thorn in a HaizeStack test for evaluating long-context adversarial robustness.
  ☆26Updated 3 months ago
• haizelabs / redteaming-resistance-benchmark
  ☆34Updated 3 months ago
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆107Updated 5 months ago
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆65Updated this week
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆208Updated last month
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆171Updated 8 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆128Updated 3 weeks ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆147Updated last month
• HumanCompatibleAI / tensor-trust-data
  Dataset for the Tensor Trust project
  ☆33Updated 8 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆140Updated 3 months ago
• agiresearch / Formal-LLM
  Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents
  ☆110Updated 5 months ago
• mlfoundations / evalchemy
  Automatic Evals for Instruction-Tuned Models
  ☆45Updated this week
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆78Updated last month
• cohere-ai / magikarp
  ☆128Updated this week
• aorwall / SWE-bench-docker
  ☆81Updated 4 months ago
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆115Updated 8 months ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆97Updated this week
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆133Updated this week