avidml / evaluating-LLMsLinks
Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
☆27Updated 10 months ago
Alternatives and similar repositories for evaluating-LLMs
Users that are interested in evaluating-LLMs are comparing it to the libraries listed below
Sorting:
- Find and fix bugs in natural language machine learning models using adaptive testing.☆188Updated last year
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆200Updated 9 months ago
- AI Data Management & Evaluation Platform☆215Updated 2 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆67Updated 2 years ago
- AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness☆103Updated last year
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆93Updated 2 years ago
- Notebooks for training universal 0-shot classifiers on many different tasks☆139Updated last year
- Credo AI Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central …☆48Updated last year
- Command Line Interface for Hugging Face Inference Endpoints☆65Updated last year
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆182Updated 3 years ago
- ☆261Updated 10 months ago
- This repo contains the code for generating the ToxiGen dataset, published at ACL 2022.☆345Updated last year
- ☆153Updated 3 years ago
- Annotated corpus + evaluation metrics for text anonymisation☆70Updated 2 weeks ago
- ☆228Updated 4 years ago
- Repository for research in the field of Responsible NLP at Meta.☆205Updated this week
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆111Updated last year
- The Foundation Model Transparency Index☆85Updated last month
- Contains all assets to run with Moonshot Library (Connectors, Datasets and Metrics)☆39Updated 2 weeks ago
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- Deliver safe & effective language models☆553Updated 2 weeks ago
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆117Updated this week
- A python package for benchmarking interpretability techniques on Transformers.☆215Updated last year
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆213Updated 4 months ago
- A library to synthesize text datasets using Large Language Models (LLM)☆152Updated 3 years ago
- Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"☆54Updated last year
- RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!☆42Updated 3 years ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆155Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆192Updated 6 months ago
- A framework for few-shot evaluation of autoregressive language models.☆106Updated 2 years ago