mlcommons / modelgaugeLinks
Make it easy to automatically and uniformly measure the behavior of many AI Systems.
☆26Updated last year
Alternatives and similar repositories for modelgauge
Users that are interested in modelgauge are comparing it to the libraries listed below
Sorting:
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆116Updated this week
- git extension for {collaborative, communal, continual} model development☆217Updated last year
- ☆56Updated 2 years ago
- A library to create and manage configuration files, especially for machine learning projects.☆79Updated 3 years ago
- Sparse and discrete interpretability tool for neural networks☆65Updated last year
- The Foundation Model Transparency Index☆85Updated last month
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆107Updated 2 years ago
- Erasing concepts from neural representations with provable guarantees☆242Updated 11 months ago
- ☆77Updated last year
- ☆14Updated last year
- AI Data Management & Evaluation Platform☆215Updated 2 years ago
- Finding semantically meaningful and accurate prompts.☆48Updated 2 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆32Updated 2 years ago
- We view Large Language Models as stochastic language layers in a network, where the learnable parameters are the natural language prompts…☆95Updated last year
- Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…☆35Updated 2 years ago
- ☆64Updated this week
- Experiments for efforts to train a new and improved t5☆76Updated last year
- ModelDiff: A Framework for Comparing Learning Algorithms☆58Updated 2 years ago
- ☆31Updated 2 years ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- ☆69Updated last year
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Updated 2 years ago
- ☆44Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆259Updated 2 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Understanding how features learned by neural networks evolve throughout training☆41Updated last year
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆180Updated 3 years ago
- Functional Benchmarks and the Reasoning Gap☆90Updated last year
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆30Updated 3 months ago
- ☆30Updated 2 years ago