avidml / evaluating-LLMs
Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
☆21Updated last year
Related projects: ⓘ
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆66Updated last year
- A Python library aimed at dissecting and augmenting NER training data.☆56Updated last year
- 💫 SpaCy wrapper for ConceptNet 💫☆88Updated last year
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆99Updated 4 months ago
- ☆41Updated last year
- ☆13Updated last year
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…☆37Updated 2 years ago
- Explainable Zero-Shot Topic Extraction☆62Updated last month
- Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)☆102Updated last year
- Using short models to classify long texts☆20Updated last year
- A library to synthesize text datasets using Large Language Models (LLM)☆151Updated last year
- Tools for managing datasets for governance and training.☆77Updated last month
- Source code and data for Like a Good Nearest Neighbor☆28Updated 7 months ago
- ☆28Updated 7 months ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆91Updated last year
- A monolingual and cross-lingual meta-embedding generation and evaluation framework☆79Updated 2 years ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆118Updated 6 months ago
- Generalist and Lightweight Model for Text Classification☆29Updated 2 weeks ago
- Detecting Bias and ensuring Fairness in AI solutions☆77Updated last year
- A spaCy custom component that extracts and normalizes temporal expressions☆53Updated last year
- SPRINT Toolkit helps you evaluate diverse neural sparse models easily using a single click on any IR dataset.☆40Updated last year
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆77Updated 6 months ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆59Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆143Updated 2 months ago
- Open source library for few shot NLP☆78Updated last year
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆40Updated 3 years ago
- 🧪 Experimental features for Haystack☆14Updated this week
- ☆82Updated 3 weeks ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆51Updated 3 months ago
- The codebase for our ACL2023 paper: Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learni…☆26Updated last year
- We believe the ability of an LLM to attribute the text that it generates is likely to be crucial for both system developers and users in …☆42Updated last year