Alternatives and similar repositories for ailuminate

Users that are interested in ailuminate are comparing it to the libraries listed below

• princeton-pli / hal-harness
  ☆129Updated last week
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆108Updated 5 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆161Updated last year
• RapidResponseBench / rapidresponsebench
  ☆34Updated 10 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆95Updated this week
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆112Updated last week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆182Updated 6 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆103Updated 5 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆115Updated last year
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆213Updated 7 months ago
• openai / emergent-misalignment-persona-features
  ☆35Updated 2 months ago
• allenai / agent-baselines
  ☆58Updated 2 weeks ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆62Updated 9 months ago
• allenai / infinigram-api
  ☆81Updated 2 weeks ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆111Updated 4 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆168Updated this week
• google-deepmind / dangerous-capability-evaluations
  ☆57Updated last month
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆150Updated 7 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 11 months ago
• safety-research / open-source-alignment-faking
  Open Source Replication of Anthropic's Alignment Faking Paper
  ☆50Updated 5 months ago
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆112Updated 10 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆24Updated last week
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆140Updated last year
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆55Updated 6 months ago
• MurtyShikhar / NNetnav
  Interaction-first method for generating demonstrations for web-agents on any website
  ☆48Updated 4 months ago
• google-deepmind / mishax
  ☆142Updated last week
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆50Updated 10 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 5 months ago
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆165Updated 4 months ago