kr-ramesh / synthtextevalLinks
SynthTextEval: A Toolkit for Generating and Evaluating Synthetic Data For High-Stakes Domains (EMNLP 2025 System Demonstration)
☆24Updated last month
Alternatives and similar repositories for synthtexteval
Users that are interested in synthtexteval are comparing it to the libraries listed below
Sorting:
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆151Updated 5 months ago
- A simple evaluation of generative language models and safety classifiers.☆79Updated last month
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆93Updated last year
- Code for Zero-Shot Tokenizer Transfer☆142Updated 11 months ago
- Official Repository for Dataset Inference for LLMs☆43Updated last year
- Repository for the ACL 2024 conference website☆18Updated 10 months ago
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆26Updated 4 months ago
- Resources for cultural NLP research☆110Updated 2 months ago
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆21Updated 3 months ago
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆31Updated 7 months ago
- ☆50Updated last year
- Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…☆35Updated 2 years ago
- ☆58Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- A package dedicated for running benchmark agreement testing☆18Updated 2 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- ☆87Updated last week
- Repository for research in the field of Responsible NLP at Meta.☆204Updated 6 months ago
- ☆34Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆80Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆130Updated 9 months ago
- Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).☆93Updated 4 months ago
- Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba☆31Updated last month
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆71Updated last year
- ☆38Updated 2 years ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆86Updated last year
- Synthetic Data Generation for Evaluation☆13Updated 9 months ago
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆57Updated 5 months ago
- BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages☆42Updated 4 months ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆12Updated 10 months ago