Make it easy to automatically and uniformly measure the behavior of many AI Systems.
☆27Oct 2, 2024Updated last year
Alternatives and similar repositories for modelgauge
Users that are interested in modelgauge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆129Updated this week
- ☆15Sep 22, 2023Updated 2 years ago
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆14Oct 3, 2024Updated last year
- A Python micro framework for creating LLM-driven agents☆22May 20, 2025Updated last year
- This repository contains data, code and models for contextual noncompliance.☆26Jul 18, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Scratchpad/Chain-of-Thought Prompts☆12Jun 6, 2022Updated 4 years ago
- Java API for immoweb.be☆13Updated this week
- ARCADE198 Dataset from the ACL 2018 MRQA Workshop☆15Oct 29, 2018Updated 7 years ago
- A tutorial to set up a running compute cluster on cloud resources☆11Jul 7, 2023Updated 3 years ago
- SPIRO is a Smart Plate Imaging Robot☆11May 20, 2026Updated 2 months ago
- Realign is a testing and simulation framework for AI applications.☆19Dec 4, 2024Updated last year
- [NeurIPS'24 LanGame workshop] On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆42Apr 10, 2026Updated 3 months ago
- Principal component analysis using a linear autoencoder☆16May 25, 2019Updated 7 years ago
- ☆14Apr 27, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Python package for generating datasets to evaluate reasoning and retrieval of large language models☆26Jun 3, 2026Updated last month
- Documents for Information Theory used in Master of Logic course Information Theory at the UvA☆37Dec 8, 2020Updated 5 years ago
- multimodal anomaly detection☆14Jan 17, 2021Updated 5 years ago
- Grey-brick buildings, an open source data set of 225 calibrated Dutch residential building heat models, comprising identified models and …☆22Feb 2, 2023Updated 3 years ago
- A curated list of references to help you get up to speed with the concepts and techniques needed to become a successful ML researcher.☆16Jan 20, 2022Updated 4 years ago
- Fluent dreaming for language models☆13Jul 22, 2024Updated 2 years ago
- Ochami deployment recipes☆14Jul 16, 2026Updated last week
- EPCC I/O benchmarking applications☆12Dec 15, 2021Updated 4 years ago
- ☆43Aug 31, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Skill to annotate and create ai judges from agent logs☆17Oct 28, 2025Updated 8 months ago
- Sketching-based matrix computations for numpy arrays☆17Oct 29, 2019Updated 6 years ago
- ☆16May 30, 2024Updated 2 years ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Feb 22, 2024Updated 2 years ago
- [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…☆11Nov 28, 2023Updated 2 years ago
- PyTorch Implementation of the CLIP Algorithm☆14Sep 23, 2024Updated last year
- ☆13Jun 4, 2024Updated 2 years ago
- Project for SNARE benchmark☆11Jun 5, 2024Updated 2 years ago
- Code for Hutch++: Optimal Stochastic Trace Estimation☆13Aug 30, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AIBench, a tool for comparing and evaluating AI serving solutions. forked from [tsbs](https://github.com/timescale/tsbs) and adapted to A…☆21Sep 4, 2024Updated last year
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆18Apr 15, 2025Updated last year
- Low-carbon Expansion Generation Optimization (LEGO) model☆16Sep 19, 2025Updated 10 months ago
- This repo contains the scripts used to create the data for the ATC2020 paper "Reconstructing proprietary video streaming algorithms"☆14Mar 24, 2021Updated 5 years ago
- Examples of reinforcement learning using PyTorch to solve the OpenAI Gym problems☆18Mar 15, 2023Updated 3 years ago
- [CVPR 2020] A generative model with latent factors that are independent and localized.☆12Mar 27, 2025Updated last year