avidml / evaluating-LLMsLinks
Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
☆25Updated 4 months ago
Alternatives and similar repositories for evaluating-LLMs
Users that are interested in evaluating-LLMs are comparing it to the libraries listed below
Sorting:
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆189Updated 3 months ago
- Find and fix bugs in natural language machine learning models using adaptive testing.☆184Updated last year
- Annotated corpus + evaluation metrics for text anonymisation☆60Updated 2 weeks ago
- A python package for benchmarking interpretability techniques on Transformers.☆214Updated 10 months ago
- Pipeline for pulling and processing online language model pretraining data from the web☆177Updated 2 years ago
- A library to synthesize text datasets using Large Language Models (LLM)☆152Updated 2 years ago
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆147Updated 2 months ago
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆108Updated last year
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆66Updated 2 years ago
- Repository for research in the field of Responsible NLP at Meta.☆202Updated 2 months ago
- A framework for few-shot evaluation of autoregressive language models.☆105Updated 2 years ago
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆94Updated last year
- Command Line Interface for Hugging Face Inference Endpoints☆66Updated last year
- triple-encoders is a library for contextualizing distributed Sentence Transformers representations.☆14Updated 11 months ago
- A High-level Library for Named Entity Recognition in Python.☆24Updated last year
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆206Updated this week
- Deliver safe & effective language models☆532Updated last week
- ☆137Updated 3 years ago
- Tools for managing datasets for governance and training.☆85Updated 2 months ago
- The Foundation Model Transparency Index☆83Updated last year
- AI Data Management & Evaluation Platform☆215Updated last year
- AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness☆102Updated 6 months ago
- Topic modeling helpers using managed language models from Cohere. Name text clusters using large GPT models.☆223Updated 2 years ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆150Updated last year
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 3 years ago
- Notebooks for training universal 0-shot classifiers on many different tasks☆135Updated 7 months ago
- ☆216Updated 4 years ago
- The pipeline for the OSCAR corpus☆171Updated last year
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆337Updated 2 years ago
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆178Updated 3 years ago