Alternatives and similar repositories for modelgauge:

Users that are interested in modelgauge are comparing it to the libraries listed below

• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆81Updated this week
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆59Updated last year
• jlko / active-surrogate-estimators
  ☆12Updated 3 years ago
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆41Updated 8 months ago
• MadryLab / datamodels
  ☆28Updated last year
• XiangLi1999 / AutoBencher
  ☆26Updated 8 months ago
• VectorInstitute / flex_model
  ☆13Updated last year
• tianyu139 / meaning-as-trajectories
  Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)
  ☆20Updated 9 months ago
• apartresearch / interpretability-starter
  🧠 Starter templates for doing interpretability research
  ☆66Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 9 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆31Updated last year
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆88Updated this week
• shoaibahmed / metadata_archaeology
  Official code for the paper: "Metadata Archaeology"
  ☆19Updated last year
• matfrei / CLIPMasterPrints
  Code for Fooling Contrastive Language-Image Pre-trainined Models with CLIPMasterPrints
  ☆16Updated 4 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 3 months ago
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆95Updated last year
• CannyLab / anthology
  [EMNLP 2024 Main] Virtual Personas for Language Models via an Anthology of Backstories
  ☆26Updated 3 months ago
• amazon-science / llm-interpret
  Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…
  ☆29Updated last year
• kanishkg / synchromesh
  Get language models to generate responses in a specific format reliably. Open source implementation of Synchromesh: Reliable code generat…
  ☆27Updated last year
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆103Updated last year
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆108Updated 9 months ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆32Updated 7 months ago
• allenai / bff
  ☆38Updated 10 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• guy-dar / embedding-space
  ☆53Updated last year
• IBM / dolomite-engine
  Dolomite Engine is a library for pretraining/finetuning LLMs
  ☆42Updated last week