mlcommons / modelgaugeLinks
Make it easy to automatically and uniformly measure the behavior of many AI Systems.
☆26Updated 10 months ago
Alternatives and similar repositories for modelgauge
Users that are interested in modelgauge are comparing it to the libraries listed below
Sorting:
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆99Updated this week
- Sparse and discrete interpretability tool for neural networks☆63Updated last year
- We view Large Language Models as stochastic language layers in a network, where the learnable parameters are the natural language prompts…☆94Updated last year
- ☆75Updated last year
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆107Updated last year
- The Foundation Model Transparency Index☆82Updated last year
- ☆54Updated 2 years ago
- codebase release for EMNLP2023 paper publication☆19Updated 3 months ago
- [EMNLP 2024 Main] Virtual Personas for Language Models via an Anthology of Backstories☆30Updated 8 months ago
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- Functional Benchmarks and the Reasoning Gap☆88Updated 10 months ago
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆94Updated last year
- ☆69Updated 11 months ago
- Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…☆31Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆28Updated last year
- Erasing concepts from neural representations with provable guarantees☆232Updated 6 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- A mechanistic approach for understanding and detecting factual errors of large language models.☆47Updated last year
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 7 months ago
- git extension for {collaborative, communal, continual} model development☆217Updated 8 months ago
- Understanding how features learned by neural networks evolve throughout training☆36Updated 9 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- Code for the paper "Fishing for Magikarp"☆162Updated 2 months ago
- ☆44Updated 8 months ago
- ☆28Updated 6 months ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆208Updated 2 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆86Updated last year
- Evaluating LLMs with CommonGen-Lite☆90Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year
- The repository contains code for Adaptive Data Optimization☆25Updated 8 months ago