AIS is an evaluation framework for assessing whether the output of natural language models only contains information about the external world that is verifiable in source documents, or "Attributable to Identified Sources".
☆30Jan 14, 2023Updated 3 years ago
Alternatives and similar repositories for AIS
Users that are interested in AIS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆25Mar 10, 2025Updated last year
- ☆22Jan 5, 2024Updated 2 years ago
- Student materials for Stats/Datasci 507, Fall 2021.☆10Dec 10, 2021Updated 4 years ago
- Evaluation results for Machine Translation within the BigScience project☆11May 15, 2023Updated 3 years ago
- The InterScript dataset contains interactive user feedback on scripts generated by a T5-XXL model.☆12Dec 15, 2021Updated 4 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [APSIPA ASC 2023] The official code of paper, "FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Au…☆18Mar 7, 2024Updated 2 years ago
- ☆15Apr 29, 2025Updated last year
- Code for EMNLP 2021 paper "Measuring Association Between Labels and Free-Text Rationales"☆12Sep 12, 2023Updated 3 years ago
- Code for Evaluating Explanations for Reading Comprehension with Realistic Counterfactuals.☆17Apr 25, 2021Updated 5 years ago
- Machine Learning for Authorship Identification using Gutenberg Data☆17Mar 6, 2017Updated 9 years ago
- Transformer-based model for learning authorship representations.☆55Aug 12, 2024Updated 2 years ago
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆93Jun 16, 2026Updated 3 months ago
- Code for the paper "Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers"☆18Dec 15, 2020Updated 5 years ago
- ☆27Nov 6, 2022Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The SMAPH system for query entity linking.☆20Jul 29, 2018Updated 8 years ago
- ☆13Oct 28, 2022Updated 3 years ago
- Code for gradient rollback, which explains predictions of neural matrix factorization models, as for example used for knowledge base comp…☆21Mar 16, 2021Updated 5 years ago
- Code for the article "Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning", Outstanding Paper at EMNLP20…☆10Nov 7, 2021Updated 4 years ago
- A paper list of research conducted based on wikiHow☆27Mar 5, 2022Updated 4 years ago
- ☆19Nov 21, 2025Updated 10 months ago
- EyeBench: Predictive Modeling from Eye Movements in Reading☆19Apr 6, 2026Updated 6 months ago
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆457Apr 13, 2025Updated last year
- A zero-shot faithfulness evaluation metric for text summarization☆11Oct 17, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10May 27, 2024Updated 2 years ago
- ☆26Mar 20, 2024Updated 2 years ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆154May 18, 2024Updated 2 years ago
- ☆11Sep 27, 2024Updated 2 years ago
- ☆12Mar 4, 2025Updated last year
- Keyword Extraction for Pathology Reports with BERT☆12Sep 2, 2020Updated 6 years ago
- Exploring aspects of similarity between spoken personal narratives by disentangling them into narrative clause types -- Supplementary inf…☆12Jul 14, 2020Updated 6 years ago
- IPython Notebook for Sentiment Classification☆10Nov 12, 2014Updated 11 years ago
- ☆11Oct 2, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A case study approach to successful data science projects using Python pandas and scikit learn☆10Jun 27, 2019Updated 7 years ago
- Github repo for the Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification, code and data | Paper: https://ar…☆14Apr 6, 2023Updated 3 years ago
- Feature Selection using Simulated Annealing☆11Aug 10, 2022Updated 4 years ago
- [ACL 2024] FactPICO☆12Feb 26, 2024Updated 2 years ago
- WorldCuisines is an extensive multilingual and multicultural benchmark that spans 30 languages, covering a wide array of global cuisines.…☆27May 8, 2025Updated last year
- An optimization-based algorithm to accurately estimate the causal effects and robustly predict under distribution shifts. It leverages th…☆14Jul 10, 2024Updated 2 years ago
- ☆13Jul 6, 2021Updated 5 years ago