clp-research / clemcoreLinks
A Framework for the Systematic Evaluation of Chat-Optimized Language Models as Conversational Agents and an Extensible Benchmark
☆30Updated this week
Alternatives and similar repositories for clemcore
Users that are interested in clemcore are comparing it to the libraries listed below
Sorting:
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆78Updated last year
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆24Updated 4 months ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆73Updated last year
- ☆66Updated last year
- code associated with WANLI dataset in Liu et al., 2022☆30Updated 2 years ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆59Updated 11 months ago
- Query-focused summarization data☆42Updated 2 years ago
- EMNLP 2022: Finding Dataset Shortcuts with Grammar Induction https://arxiv.org/abs/2210.11560☆58Updated 4 months ago
- Do Multilingual Language Models Think Better in English?☆42Updated last year
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆22Updated 10 months ago
- AIS is an evaluation framework for assessing whether the output of natural language models only contains information about the external w…☆31Updated 2 years ago
- ☆25Updated 2 years ago
- ☆24Updated 10 months ago
- ☆36Updated last year
- ☆14Updated last month
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆41Updated last year
- https://arxiv.org/abs/2404.10917☆14Updated 3 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- The official implementation of "Distilling Relation Embeddings from Pre-trained Language Models, EMNLP 2021 main conference", a high-qual…☆47Updated 7 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Updated last year
- Benchmarking Generalization to New Tasks from Natural Language Instructions☆26Updated 4 years ago
- ☆44Updated 8 months ago
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"☆59Updated 5 months ago
- The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…☆63Updated 2 years ago
- LogiTorch is a PyTorch-based library for logical reasoning on natural language☆73Updated 10 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆103Updated last year
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16Updated 3 years ago
- ☆28Updated last month
- A extension of Transformers library to include T5ForSequenceClassification class.☆38Updated 2 years ago
- Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)☆78Updated last year