avidml / evaluating-LLMsLinks
Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
☆27Updated 10 months ago
Alternatives and similar repositories for evaluating-LLMs
Users that are interested in evaluating-LLMs are comparing it to the libraries listed below
Sorting:
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆198Updated 9 months ago
- Find and fix bugs in natural language machine learning models using adaptive testing.☆188Updated last year
- AI Data Management & Evaluation Platform☆215Updated 2 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆67Updated 2 years ago
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆93Updated 2 years ago
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆181Updated 3 years ago
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆111Updated last year
- AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness☆102Updated 11 months ago
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆118Updated this week
- A python package for benchmarking interpretability techniques on Transformers.☆215Updated last year
- codebase release for EMNLP2023 paper publication☆19Updated 4 months ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆190Updated 6 months ago
- The Foundation Model Transparency Index☆85Updated last month
- Repository for research in the field of Responsible NLP at Meta.☆204Updated 8 months ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆212Updated last week
- An open collection of implementation tips, tricks and resources for training large language models☆491Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆105Updated 2 years ago
- Annotated corpus + evaluation metrics for text anonymisation☆70Updated 5 months ago
- A library to synthesize text datasets using Large Language Models (LLM)☆152Updated 3 years ago
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- The world's largest social media toxicity dataset.☆189Updated 3 years ago
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆338Updated 2 years ago
- ☆153Updated 3 years ago
- A Python library aimed at dissecting and augmenting NER training data.☆60Updated 2 years ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated 2 months ago
- Pipeline for pulling and processing online language model pretraining data from the web☆177Updated 2 years ago
- Command Line Interface for Hugging Face Inference Endpoints☆65Updated last year
- Open source no-code system for text annotation and building of text classifiers☆271Updated 7 months ago
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆212Updated 4 months ago
- Code for the paper "Fishing for Magikarp"☆178Updated 8 months ago