ronigold / TokenSHAP
TokenSHAP: Explain individual token importance in large language model prompts with SHAP values. Gain insights, debug models, detect biases, and enhance transparency effortlessly
☆40Updated 3 weeks ago
Alternatives and similar repositories for TokenSHAP:
Users that are interested in TokenSHAP are comparing it to the libraries listed below
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 9 months ago
- An introduction to LLM Sampling☆77Updated 4 months ago
- Library to facilitate pruning of LLMs based on context☆32Updated last year
- A package dedicated for running benchmark agreement testing☆16Updated 5 months ago
- Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning☆46Updated last year
- ☆53Updated last week
- I learn about and explain quantization☆26Updated last year
- Pre-train Static Word Embeddings☆56Updated 2 weeks ago
- ☆46Updated 5 months ago
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆120Updated 8 months ago
- SaLSa Optimizer implementation (No learning rates needed)☆29Updated 2 weeks ago
- 🦄 Unitxt: a python library for getting data fired up and set for training and evaluation☆187Updated this week
- My personal site☆73Updated 8 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 5 months ago
- ☆44Updated 3 months ago
- ☆21Updated last year
- A repository containing the code for translating popular LLM benchmarks to German.☆25Updated last year
- A repository containing general tutorials I'd like to share with the world.☆38Updated this week
- Mixing Language Models with Self-Verification and Meta-Verification☆104Updated 4 months ago
- This repository contains the source code for the Saving 77% of the Parameters in Large Language Models Technical Report☆29Updated last month
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- This is the code that went into our practical dive using mamba as information extraction☆54Updated last year
- PyTorch library for Active Fine-Tuning☆64Updated 2 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated 11 months ago
- Prune transformer layers☆68Updated 10 months ago
- code for training & evaluating Contextual Document Embedding models☆181Updated last week
- Official implementation of MetaTree: Learning a Decision Tree Algorithm with Transformers☆106Updated 7 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆106Updated 7 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆196Updated 2 weeks ago
- A mechanistic approach for understanding and detecting factual errors of large language models.☆43Updated 9 months ago