AIS is an evaluation framework for assessing whether the output of natural language models only contains information about the external world that is verifiable in source documents, or "Attributable to Identified Sources".
☆31Jan 14, 2023Updated 3 years ago
Alternatives and similar repositories for AIS
Users that are interested in AIS are comparing it to the libraries listed below
Sorting:
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆26Mar 10, 2025Updated 11 months ago
- mReasoner is a unified computational implementation of the model theory of thinking and reasoning☆13Aug 17, 2023Updated 2 years ago
- TREC Core track☆11Jul 5, 2017Updated 8 years ago
- Code for EMNLP 2021 paper "Measuring Association Between Labels and Free-Text Rationales"☆12Sep 12, 2023Updated 2 years ago
- Evaluation results for Machine Translation within the BigScience project☆11May 15, 2023Updated 2 years ago
- The InterScript dataset contains interactive user feedback on scripts generated by a T5-XXL model.☆12Dec 15, 2021Updated 4 years ago
- Machine Learning for Authorship Identification using Gutenberg Data☆16Mar 6, 2017Updated 8 years ago
- Paper list for the paper "Authorship Attribution in the Era of Large Language Models: Problems, Methodologies, and Challenges (SIGKDD Exp…☆18Dec 23, 2024Updated last year
- Hadoop tools for manipulating ClueWeb collections☆26Jul 15, 2016Updated 9 years ago
- ☆18Oct 6, 2022Updated 3 years ago
- Code for Evaluating Explanations for Reading Comprehension with Realistic Counterfactuals.☆18Apr 25, 2021Updated 4 years ago
- Student materials for Stats/Datasci 507, Fall 2021.☆10Dec 10, 2021Updated 4 years ago
- Transformer-based model for learning authorship representations.☆47Aug 12, 2024Updated last year
- WorldCuisines is an extensive multilingual and multicultural benchmark that spans 30 languages, covering a wide array of global cuisines.…☆24May 8, 2025Updated 9 months ago
- ☆19Nov 21, 2025Updated 3 months ago
- Code for the paper "Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers"☆18Dec 15, 2020Updated 5 years ago
- The SMAPH system for query entity linking.☆20Jul 29, 2018Updated 7 years ago
- Implementation of sequential Information Bottleneck (sIB) in Python and in C++☆20Updated this week
- The Art and Science of Empirical Computer Science (Fall 2022)☆21Sep 1, 2023Updated 2 years ago
- ☆34Jan 17, 2020Updated 6 years ago
- ☆27Nov 6, 2022Updated 3 years ago
- Open Source / ENTSUM: A Data Set for Entity-Centric Extractive Summarization☆29May 23, 2022Updated 3 years ago
- ☆25Oct 22, 2022Updated 3 years ago
- Dataset and Codes for our EMNLP 2022 Main Conference Long Paper titled "ECTSum: A New Benchmark Dataset For Bullet Point Summarization of…☆32May 22, 2024Updated last year
- A paper list of research conducted based on wikiHow☆27Mar 5, 2022Updated 4 years ago
- Composable inference algorithms with LLMs and programmable logic☆69Dec 4, 2024Updated last year
- VERA-MH official repository☆30Updated this week
- ☆13Oct 5, 2025Updated 5 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Aug 15, 2023Updated 2 years ago
- Code for NAACL 2022 paper "Reframing Human-AI Collaboration for Generating Free-Text Explanations"☆31Apr 28, 2023Updated 2 years ago
- ☆36Oct 14, 2022Updated 3 years ago
- Submission archive for the MS MARCO document ranking leaderboard☆31Oct 9, 2023Updated 2 years ago
- 🪝PISCES - Precise In-Parameter Suppression for Concept EraSure in Large Language Models☆12May 30, 2025Updated 9 months ago
- A PaaS End-to-End ML Setup with Metaflow, Serverless and SageMaker.☆37Feb 10, 2021Updated 5 years ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆154May 18, 2024Updated last year
- Interpretable Neural Predictions with Differentiable Binary Variables☆85May 7, 2021Updated 4 years ago
- Transition-based NER system☆35Jun 22, 2018Updated 7 years ago
- Interpretating the latent space representations of attention head outputs for LLMs☆39Aug 13, 2024Updated last year
- COLING 2022: A Coarse-to-fine Cascaded Evidence-Distillation Neural Network for Explainable Fake News Detection.☆101Feb 3, 2026Updated last month