Alternatives and similar repositories for modelgauge

Users that are interested in modelgauge are comparing it to the libraries listed below

• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆117Updated this week
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆217Updated last year
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆93Updated 2 years ago
• guy-dar / embedding-space
  ☆57Updated 2 years ago
• google-deepmind / dangerous-capability-evaluations
  ☆65Updated this week
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆49Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆112Updated 11 months ago
• microsoft / deep-language-networks
  We view Large Language Models as stochastic language layers in a network, where the learnable parameters are the natural language prompts…
  ☆95Updated last year
• MadryLab / datamodels
  ☆32Updated 2 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆79Updated 3 years ago
• stanford-crfm / fmti
  The Foundation Model Transparency Index
  ☆85Updated 2 months ago
• amazon-science / llm-interpret
  Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…
  ☆35Updated 2 years ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆243Updated last year
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆135Updated 3 years ago
• IBM / inFairness
  PyTorch package to train and audit ML models for Individual Fairness
  ☆66Updated 4 months ago
• hadasah / btm
  ☆77Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• google-deepmind / mishax
  ☆152Updated 5 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆28Updated last year
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆261Updated 10 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆260Updated 2 years ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆99Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• zeno-ml / zeno
  AI Data Management & Evaluation Platform
  ☆215Updated 2 years ago
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆74Updated 3 years ago
• allenai / bff
  ☆38Updated last year
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆48Updated 2 years ago
• IBM / ensemble-instruct
  codebase release for EMNLP2023 paper publication
  ☆19Updated 4 months ago