kr-ramesh / synthtextevalLinks
SynthTextEval: A Toolkit for Generating and Evaluating Synthetic Data For High-Stakes Domains (EMNLP 2025 System Demonstration)
☆26Updated 3 months ago
Alternatives and similar repositories for synthtexteval
Users that are interested in synthtexteval are comparing it to the libraries listed below
Sorting:
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆31Updated 9 months ago
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆62Updated 7 months ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆94Updated last year
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆12Updated last year
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆75Updated 7 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆163Updated 7 months ago
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆26Updated 6 months ago
- Resources for cultural NLP research☆113Updated 4 months ago
- LLM Attributor: Attribute LLM's Generated Text to Training Data☆72Updated 4 months ago
- ☆59Updated last year
- Python package for measuring memorization in LLMs.☆184Updated 6 months ago
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆24Updated 5 months ago
- Official Repository for Dataset Inference for LLMs☆43Updated last year
- ☆38Updated last year
- Code for Zero-Shot Tokenizer Transfer☆142Updated last year
- ☆39Updated 2 years ago
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆57Updated 3 months ago
- ☆93Updated last month
- Code for "On Measuring Faithfulness of Natural Language Explanations"☆21Updated last year
- Code for the MTEB Arena☆24Updated 7 months ago
- https://footprints.baulab.info☆17Updated last year
- SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 di…☆38Updated 2 years ago
- Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).☆98Updated 6 months ago
- Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba☆34Updated 3 months ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆72Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆80Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆140Updated 11 months ago
- A simple evaluation of generative language models and safety classifiers.☆85Updated last month
- [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆40Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year