SALT-NLP / CoAnnotating
This is the official repository for "CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation"
☆21Updated last year
Alternatives and similar repositories for CoAnnotating
Users that are interested in CoAnnotating are comparing it to the libraries listed below
Sorting:
- Code and data for the ACL 2024 Findings paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"☆26Updated 11 months ago
- Code and data for the FACTOR paper☆46Updated last year
- The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…☆61Updated last year
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆33Updated 5 months ago
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆44Updated 10 months ago
- First explanation metric (diagnostic report) for text generation evaluation☆61Updated 2 months ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆78Updated last year
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆35Updated 8 months ago
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆57Updated 9 months ago
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆13Updated last week
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆80Updated 2 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024☆29Updated 4 months ago
- On Transferability of Prompt Tuning for Natural Language Processing☆99Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆123Updated 8 months ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- This is the official implementation of the paper: "Contrastive Learning of Sentence Embeddings from Scratch"☆38Updated last year
- Official codebase for permutation self-consistency.☆18Updated last year
- RARR: Researching and Revising What Language Models Say, Using Language Models☆46Updated last year
- A curated list of research papers and resources on Cultural LLM.☆42Updated 7 months ago
- Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval☆45Updated 6 months ago
- NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning☆25Updated 2 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆36Updated 4 months ago
- FrugalScore is an approach to learn a fixed, low cost version of any expensive NLG metric, while retaining most of its original performan…☆15Updated 2 years ago
- ☆174Updated 2 years ago
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆23Updated last year
- ☆50Updated last year
- ☆41Updated last year
- ☆16Updated 2 months ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆41Updated last year