avidml / evaluating-LLMsLinks
Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
☆23Updated 2 months ago
Alternatives and similar repositories for evaluating-LLMs
Users that are interested in evaluating-LLMs are comparing it to the libraries listed below
Sorting:
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆66Updated 2 years ago
- Find and fix bugs in natural language machine learning models using adaptive testing.☆183Updated last year
- AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness☆100Updated 4 months ago
- ☆43Updated 2 years ago
- A Python library aimed at dissecting and augmenting NER training data.☆58Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆103Updated 2 years ago
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆177Updated 3 years ago
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆182Updated last month
- Efficient Attention for Long Sequence Processing☆94Updated last year
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆155Updated last year
- A python package for benchmarking interpretability techniques on Transformers.☆212Updated 8 months ago
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆333Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- ☆209Updated 4 years ago
- Tools for managing datasets for governance and training.☆85Updated last week
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆69Updated last year
- Using short models to classify long texts☆21Updated 2 years ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆183Updated 5 months ago
- 💫 SpaCy wrapper for ConceptNet 💫☆93Updated last year
- Command Line Interface for Hugging Face Inference Endpoints☆66Updated last year
- Annotated corpus + evaluation metrics for text anonymisation☆56Updated last year
- Pipeline for pulling and processing online language model pretraining data from the web☆178Updated last year
- RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!☆41Updated 2 years ago
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆109Updated last year
- Weakly Supervised End-to-End Learning (NeurIPS 2021)☆157Updated 2 years ago
- A High-level Library for Named Entity Recognition in Python.☆23Updated last year
- Developing tools to automatically analyze datasets☆73Updated 7 months ago
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆94Updated last year
- The Foundation Model Transparency Index☆79Updated last year
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆135Updated 6 months ago