AIS is an evaluation framework for assessing whether the output of natural language models only contains information about the external world that is verifiable in source documents, or "Attributable to Identified Sources".
☆31Jan 14, 2023Updated 3 years ago
Alternatives and similar repositories for AIS
Users that are interested in AIS are comparing it to the libraries listed below
Sorting:
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆26Mar 10, 2025Updated last year
- ☆22Jan 5, 2024Updated 2 years ago
- Evaluation results for Machine Translation within the BigScience project☆11May 15, 2023Updated 2 years ago
- mReasoner is a unified computational implementation of the model theory of thinking and reasoning☆13Aug 17, 2023Updated 2 years ago
- ☆11Nov 27, 2022Updated 3 years ago
- Student materials for Stats/Datasci 507, Fall 2021.☆10Dec 10, 2021Updated 4 years ago
- ☆14Apr 29, 2025Updated 10 months ago
- TREC Core track☆11Jul 5, 2017Updated 8 years ago
- We believe the ability of an LLM to attribute the text that it generates is likely to be crucial for both system developers and users in …☆54Jul 28, 2023Updated 2 years ago
- Transformer-based model for learning authorship representations.☆47Aug 12, 2024Updated last year
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆84Feb 20, 2026Updated 3 weeks ago
- Hadoop tools for manipulating ClueWeb collections☆26Jul 15, 2016Updated 9 years ago
- ☆27Nov 6, 2022Updated 3 years ago
- Code for the paper "Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers"☆18Dec 15, 2020Updated 5 years ago
- ☆18Oct 6, 2022Updated 3 years ago
- Machine Learning for Authorship Identification using Gutenberg Data☆16Mar 6, 2017Updated 9 years ago
- WorldCuisines is an extensive multilingual and multicultural benchmark that spans 30 languages, covering a wide array of global cuisines.…☆27May 8, 2025Updated 10 months ago
- ☆25Oct 22, 2022Updated 3 years ago
- Code for the EMNLP 2020 paper titled "Chapter Captor: Text Segmentation in Novels"☆30Nov 9, 2020Updated 5 years ago
- Code for gradient rollback, which explains predictions of neural matrix factorization models, as for example used for knowledge base comp…☆21Mar 16, 2021Updated 5 years ago
- The SMAPH system for query entity linking.☆20Jul 29, 2018Updated 7 years ago
- Code for the article "Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning", Outstanding Paper at EMNLP20…☆10Nov 7, 2021Updated 4 years ago
- A paper list of research conducted based on wikiHow☆27Mar 5, 2022Updated 4 years ago
- This is the official implementation for the paper "Learning to Scaffold: Optimizing Model Explanations for Teaching"☆20May 19, 2022Updated 3 years ago
- ☆19Nov 21, 2025Updated 3 months ago
- ☆14Mar 9, 2023Updated 3 years ago
- ☆12Oct 28, 2022Updated 3 years ago
- LUNA: a Framework for Language Understanding and Naturalness Assessment.☆12Sep 9, 2023Updated 2 years ago
- ☆25Mar 20, 2024Updated last year
- An official codebase for "NormLens: Reading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Comm…☆10May 9, 2024Updated last year
- ☆10May 27, 2024Updated last year
- VERA-MH official repository☆31Updated this week
- This project studies the performance and robustness of language models and task-adaptation methods.☆154May 18, 2024Updated last year
- Exploring aspects of similarity between spoken personal narratives by disentangling them into narrative clause types -- Supplementary inf…☆12Jul 14, 2020Updated 5 years ago
- ☆11Sep 27, 2024Updated last year
- ☆17Jul 23, 2025Updated 7 months ago
- A case study approach to successful data science projects using Python pandas and scikit learn☆10Jun 27, 2019Updated 6 years ago
- IPython Notebook for Sentiment Classification☆10Nov 12, 2014Updated 11 years ago
- Github repo for the Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification, code and data | Paper: https://ar…☆14Apr 6, 2023Updated 2 years ago