Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
☆27Mar 14, 2025Updated last year
Alternatives and similar repositories for evaluating-LLMs
Users that are interested in evaluating-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- autoredteam: code for training models that automatically red team other language models☆16Aug 9, 2023Updated 3 years ago
- Official implementation of the ACL Findings 2023 paper: Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarizatio…☆15Jan 25, 2024Updated 2 years ago
- Aulas de conceitos básicos de Processamento de Linguagem Natural oferecida no Discord aberto no Turing USP☆10Jul 30, 2021Updated 5 years ago
- Mutual Information Predicts Hallucinations in Abstractive Summarization☆13Nov 14, 2022Updated 3 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆70Feb 8, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- My solution for the ''LLM - Detect AI Generated Text'' kaggle competition☆14Feb 2, 2024Updated 2 years ago
- Source code of our paper "Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation" @ ACL 2022☆13Apr 13, 2022Updated 4 years ago
- A library for Partially Homomorphic Encryption in Python☆12May 30, 2017Updated 9 years ago
- 3rd Place solution for Feedback Prize - Predicting Effective Arguments Kaggle competition☆16Sep 6, 2022Updated 4 years ago
- Transformer-based Long Document Classification☆17Nov 2, 2022Updated 3 years ago
- ☆26Nov 21, 2022Updated 3 years ago
- Evaluate Transformers from the Hub 🔥☆14Updated this week
- Evaluation and baseline scripts for the ASSIN shared task.☆11Oct 12, 2019Updated 6 years ago
- Python standalone tokenizer☆14Nov 12, 2015Updated 10 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆13Jul 31, 2025Updated last year
- Deep Just-In-Time Inconsistency Detection Between Comments and Source Code: Artifact☆23Jul 21, 2025Updated last year
- A file-backed dictionary for Python☆12Aug 15, 2022Updated 4 years ago
- 6th Position Solution Code for Kaggle - LLM Science Exam Competition☆23Jul 8, 2024Updated 2 years ago
- Universal Robustness Evaluation Toolkit (for Evasion)☆32Sep 17, 2025Updated last year
- Benchmarking various Deep Learning models such as BERT, ALBERT, BiLSTMs on the task of sentence entailment using two datasets - MultiNLI …☆28Dec 31, 2020Updated 5 years ago
- ☆14Aug 27, 2022Updated 4 years ago
- ☆16Feb 10, 2026Updated 7 months ago
- Buscador de sinônimos em português brasileiro. https://pypi.python.org/pypi/pysinonimos☆20Nov 4, 2017Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- a plugin for stackstorm☆14Feb 13, 2019Updated 7 years ago
- An awsome epub3 library.☆15Dec 2, 2023Updated 2 years ago
- Toolkit for building prompt templates for language models☆11Sep 30, 2022Updated 3 years ago
- Practical course in Natural Language Processing for Python focused in Portuguese resources☆19Jan 18, 2016Updated 10 years ago
- Notebooks and code with some RAG techniques using llamaindex☆31Apr 19, 2024Updated 2 years ago
- Self-hosted AI voice agent☆41Aug 20, 2026Updated last month
- Project repository of the paper "Less Annotating, More Classifying – Addressing the Data Scarcity Issue of Supervised Machine Learning wi…☆35Mar 19, 2024Updated 2 years ago
- ☆17Aug 12, 2024Updated 2 years ago
- A GitHub action that generates a code coverage badge☆19Aug 30, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism☆31Jul 17, 2024Updated 2 years ago
- A set of procedures to estimate the readability of a text☆15Apr 30, 2018Updated 8 years ago
- Data labeling using few shot learning GPT-3.☆25Mar 26, 2023Updated 3 years ago
- Data for EMNLP 2022 paper "arXivEdits: Understanding the Human Revision Process in Scientific Writing".☆14Sep 30, 2023Updated 2 years ago
- Modified colab notebook to train StyleGAN3 on Google Colab☆12Apr 3, 2022Updated 4 years ago
- LoRA supervised fine-tuning, RLHF (PPO) and RAG with llama-3-8B on the TLDR summarization dataset☆14Feb 2, 2025Updated last year
- By fine tuning GPT2 on News Aggregator data☆15Jan 24, 2021Updated 5 years ago