Alternatives and similar repositories for modelgauge

Users that are interested in modelgauge are comparing it to the libraries listed below

• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆104Updated this week
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated last year
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated 2 years ago
• amazon-science / llm-interpret
  Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…
  ☆31Updated 2 years ago
• microsoft / deep-language-networks
  We view Large Language Models as stochastic language layers in a network, where the learnable parameters are the natural language prompts…
  ☆94Updated last year
• MadryLab / datamodels
  ☆30Updated 2 years ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆72Updated last year
• guy-dar / embedding-space
  ☆54Updated 2 years ago
• allenai / safety-eval
  A simple evaluation of generative language models and safety classifiers.
  ☆63Updated last week
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆28Updated last year
• mcleish7 / gemstone-scaling-laws
  ☆28Updated 7 months ago
• google-deepmind / dangerous-capability-evaluations
  ☆57Updated last month
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• EleutherAI / semantic-memorization
  ☆44Updated 10 months ago
• tianyu139 / meaning-as-trajectories
  Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)
  ☆22Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆99Updated last year
• hadasah / btm
  ☆75Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• google-research / jax-influence
  ☆61Updated 3 years ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆48Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆25Updated 9 months ago
• prateeky2806 / ComPEFT
  ☆26Updated last year
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆82Updated last year
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆70Updated last year
• IBM / inFairness
  PyTorch package to train and audit ML models for Individual Fairness
  ☆66Updated this week
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆165Updated 4 months ago
• MadryLab / modeldiff
  ModelDiff: A Framework for Comparing Learning Algorithms
  ☆59Updated 2 years ago
• open-lm-engine / lm-engine
  LM engine is a library for pretraining/finetuning LLMs
  ☆66Updated last week
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆233Updated 7 months ago
• fbarez / neuroplasticity
  ☆14Updated last year