Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
☆27Mar 14, 2025Updated last year
Alternatives and similar repositories for evaluating-LLMs
Users that are interested in evaluating-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Mar 6, 2023Updated 3 years ago
- 9th solution☆11Oct 11, 2022Updated 3 years ago
- 1st place (Efficiency Track) solution for Feedback Prize - English Language Learning Kaggle competition☆11Dec 17, 2022Updated 3 years ago
- Official implementation of the ACL Findings 2023 paper: Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarizatio…☆15Jan 25, 2024Updated 2 years ago
- Mutual Information Predicts Hallucinations in Abstractive Summarization☆13Nov 14, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆69Feb 8, 2023Updated 3 years ago
- Source code of our paper "Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation" @ ACL 2022☆13Apr 13, 2022Updated 4 years ago
- VisBERT: Demo web app for "How Does BERT Answer Questions?"☆11Jul 22, 2023Updated 3 years ago
- 3rd Place solution for Feedback Prize - Predicting Effective Arguments Kaggle competition☆16Sep 6, 2022Updated 3 years ago
- Transformer-based Long Document Classification☆17Nov 2, 2022Updated 3 years ago
- ☆26Nov 21, 2022Updated 3 years ago
- Evaluate Transformers from the Hub 🔥☆14May 26, 2026Updated last month
- Deep Just-In-Time Inconsistency Detection Between Comments and Source Code: Artifact☆23Jul 21, 2025Updated last year
- A file-backed dictionary for Python☆12Aug 15, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 6th Position Solution Code for Kaggle - LLM Science Exam Competition☆24Jul 8, 2024Updated 2 years ago
- graphs from Draw.io☆14Sep 26, 2024Updated last year
- A simple & community made twitter bot. It generates X for Y to help you come up with a start up idea.☆14Dec 24, 2021Updated 4 years ago
- Benchmarking various Deep Learning models such as BERT, ALBERT, BiLSTMs on the task of sentence entailment using two datasets - MultiNLI …☆28Dec 31, 2020Updated 5 years ago
- Code for 'Alzheimer’s Disease Classification Using Cluster-based Labelling for Graph Neural Network on Tau PET Imaging and Heterogeneous …☆12Sep 13, 2022Updated 3 years ago
- Toolkit for building prompt templates for language models☆11Sep 30, 2022Updated 3 years ago
- A curated list of resources, services, and apps for teaching and learning☆13Mar 29, 2021Updated 5 years ago
- Notebooks and code with some RAG techniques using llamaindex☆31Apr 19, 2024Updated 2 years ago
- A fullstack web app uses material ui and echarts to represent statistics and uses cheerio to scrape coronavirus data in the world.☆13Feb 13, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Project repository of the paper "Less Annotating, More Classifying – Addressing the Data Scarcity Issue of Supervised Machine Learning wi…☆35Mar 19, 2024Updated 2 years ago
- ComfyUI custom nodes for HappyHorse 1.0 — Alibaba's #1 AI video model with native 1080p, integrated audio, text-to-video, image-to-video,…☆30Apr 28, 2026Updated 2 months ago
- Tone detector for node.js. Detect monotone sounds such as alarms or whistles.☆14Dec 3, 2017Updated 8 years ago
- A plugin for the GATE language technology framework for training and using machine learning models. Currently supports Mallet (MaxEnt, N…☆29Apr 17, 2023Updated 3 years ago
- The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism☆31Jul 17, 2024Updated 2 years ago
- Data labeling using few shot learning GPT-3.☆25Mar 26, 2023Updated 3 years ago
- Data for EMNLP 2022 paper "arXivEdits: Understanding the Human Revision Process in Scientific Writing".☆14Sep 30, 2023Updated 2 years ago
- By fine tuning GPT2 on News Aggregator data☆15Jan 24, 2021Updated 5 years ago
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆18Jun 26, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for co-training large language models (e.g. T0) with smaller ones (e.g. BERT) to boost few-shot performance☆16Sep 23, 2022Updated 3 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆91Jun 3, 2026Updated last month
- ☆14Sep 16, 2021Updated 4 years ago
- A3C and generic hierarchical RL for sentiment analysis tasks☆15Dec 1, 2019Updated 6 years ago
- TREC QA dataset for question answering cleaned for usage in Question Answering☆14Aug 26, 2019Updated 6 years ago
- ☆15Jun 22, 2020Updated 6 years ago
- Quick start for Errbot on Windows with PowerShell Integration☆17Jul 9, 2021Updated 5 years ago