Alternatives and similar repositories for modelgauge

Users that are interested in modelgauge are comparing it to the libraries listed below

• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆92Updated this week
• MadryLab / datamodels
  ☆28Updated 2 years ago
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆94Updated last year
• shoaibahmed / metadata_archaeology
  Official code for the paper: "Metadata Archaeology"
  ☆19Updated 2 years ago
• multimodal-interpretability / FIND
  Official implementation of FIND (NeurIPS '23) Function Interpretation Benchmark and Automated Interpretability Agents
  ☆49Updated 8 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated last year
• jlko / active-surrogate-estimators
  ☆12Updated 3 years ago
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆46Updated 11 months ago
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated 2 years ago
• automl / zero-shot-automl-with-pretrained-models
  Official repository for the paper "Zero-Shot AutoML with Pretrained Models"
  ☆47Updated last year
• amazon-science / llm-interpret
  Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…
  ☆30Updated last year
• matfrei / CLIPMasterPrints
  Code for Fooling Contrastive Language-Image Pre-trainined Models with CLIPMasterPrints
  ☆15Updated 7 months ago
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆34Updated 7 months ago
• apartresearch / interpretability-starter
  🧠 Starter templates for doing interpretability research
  ☆69Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆27Updated last year
• lchen001 / HAPI
  ☆17Updated 2 years ago
• samblouir / birdie
  ☆13Updated last week
• tianyu139 / meaning-as-trajectories
  Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)
  ☆21Updated last year
• thestephencasper / explore_establish_exploit_llms
  ☆31Updated last year
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆34Updated 10 months ago
• interpretml / LLM-Tabular-Memorization-Checker
  Testing Language Models for Memorization of Tabular Datasets.
  ☆33Updated 3 months ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆46Updated last year
• nrimsky / InfluenceFunctions
  Implementation of Influence Function approximations for differently sized ML models, using PyTorch
  ☆15Updated last year
• google-research / jax-influence
  ☆60Updated 3 years ago
• fbarez / neuroplasticity
  ☆14Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• socialfoundations / benchbench
  BenchBench is a Python package to evaluate multi-task benchmarks.
  ☆15Updated 10 months ago
• facebookresearch / Data_Acquisition_for_ML_Benchmark
  DAM Data Acquisition for ML Benchmark, as part of the DataPerf benchmark suite, https://dataperf.org/
  ☆24Updated 2 years ago
• ExtensityAI / benchmark
  Evaluation of neuro-symbolic engines
  ☆35Updated 10 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 6 months ago