mlcommons / modelgaugeLinks
Make it easy to automatically and uniformly measure the behavior of many AI Systems.
☆26Updated 9 months ago
Alternatives and similar repositories for modelgauge
Users that are interested in modelgauge are comparing it to the libraries listed below
Sorting:
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆97Updated last week
- Sparse and discrete interpretability tool for neural networks☆63Updated last year
- ☆26Updated last year
- Finding semantically meaningful and accurate prompts.☆47Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆28Updated last year
- A mechanistic approach for understanding and detecting factual errors of large language models.☆46Updated last year
- Understanding how features learned by neural networks evolve throughout training☆36Updated 8 months ago
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆94Updated last year
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆107Updated last year
- ☆29Updated 2 years ago
- Minimum Description Length probing for neural network representations☆18Updated 5 months ago
- We view Large Language Models as stochastic language layers in a network, where the learnable parameters are the natural language prompts…☆94Updated 11 months ago
- LM engine is a library for pretraining/finetuning LLMs☆59Updated this week
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 2 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆80Updated last year
- ☆44Updated 8 months ago
- Evaluation of neuro-symbolic engines☆38Updated 11 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- git extension for {collaborative, communal, continual} model development☆214Updated 8 months ago
- Official implementation of FIND (NeurIPS '23) Function Interpretation Benchmark and Automated Interpretability Agents☆49Updated 9 months ago
- ☆55Updated 9 months ago
- ☆54Updated 2 years ago
- ☆34Updated 2 years ago
- ☆75Updated last year
- Inverse Constitutional AI [ICLR 2025]: compressing pairwise preference data into a short constitution of principles.☆34Updated last week
- A library to create and manage configuration files, especially for machine learning projects.☆78Updated 3 years ago
- Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.☆42Updated 4 months ago
- ☆60Updated 3 years ago
- Experiments for efforts to train a new and improved t5☆76Updated last year
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆127Updated 2 years ago