kr-ramesh / synthtextevalLinks
SynthTextEval: A Toolkit for Generating and Evaluating Synthetic Data For High-Stakes Domains (EMNLP 2025 System Demonstration)
☆26Updated 3 months ago
Alternatives and similar repositories for synthtexteval
Users that are interested in synthtexteval are comparing it to the libraries listed below
Sorting:
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆163Updated 7 months ago
- LLM Attributor: Attribute LLM's Generated Text to Training Data☆70Updated 4 months ago
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆31Updated 9 months ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆94Updated last year
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆61Updated 7 months ago
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆24Updated 5 months ago
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆26Updated 6 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆136Updated last year
- A simple evaluation of generative language models and safety classifiers.☆85Updated last month
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆80Updated last year
- Code for Zero-Shot Tokenizer Transfer☆142Updated last year
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆142Updated 3 months ago
- Repository for the ACL 2024 conference website☆18Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…☆35Updated 2 years ago
- Resources for cultural NLP research☆113Updated 4 months ago
- ☆17Updated 5 months ago
- ☆38Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆140Updated 11 months ago
- https://footprints.baulab.info☆17Updated last year
- ☆59Updated last year
- ☆91Updated last month
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆72Updated last year
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆112Updated last year
- Repository for research in the field of Responsible NLP at Meta.☆205Updated this week
- FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists☆31Updated 5 months ago
- Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba☆34Updated 3 months ago
- ☆39Updated 2 years ago
- ☆24Updated 8 months ago
- Engine for collecting, uploading, and downloading model activations☆25Updated 10 months ago