AugustasMacijauskas / trailtokenLinks
An application that visualises LLM tokenizers
☆10Updated 9 months ago
Alternatives and similar repositories for trailtoken
Users that are interested in trailtoken are comparing it to the libraries listed below
Sorting:
- An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"☆315Updated 9 months ago
- ☆62Updated last year
- Einsum with einops style variable names☆16Updated last year
- Mechanistic Interpretability Visualizations using React☆257Updated 6 months ago
- Seminar on Large Language Models (COMP790-101 at UNC Chapel Hill, Fall 2022)☆310Updated 2 years ago
- A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.☆21Updated 2 months ago
- Find and fix bugs in natural language machine learning models using adaptive testing.☆183Updated last year
- ☆121Updated last year
- Mechanistic Interpretability for Transformer Models☆51Updated 3 years ago
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆177Updated 3 years ago
- ☆77Updated 4 months ago
- This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polish☆13Updated last year
- PAIR.withgoogle.com and friend's work on interpretability methods☆192Updated this week
- An interactive exploration of Transformer programming.☆265Updated last year
- Extract full next-token probabilities via language model APIs☆247Updated last year
- Embeddings: State-of-the-art Text Representations for Natural Language Processing tasks, an initial version of library focus on the Polis…☆36Updated last year
- A library for finding knowledge neurons in pretrained transformer models.☆158Updated 3 years ago
- Erasing concepts from neural representations with provable guarantees☆228Updated 5 months ago
- Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.☆292Updated 11 months ago
- Code for the paper "Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languages" (N…☆14Updated 2 months ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆207Updated 2 weeks ago
- ☆227Updated 8 months ago
- natbib compatible splncs04.bst (Springer LNCS) BibTeX Style File built using a docstrip with the conventional merlin.mbs master file.☆51Updated 3 years ago
- Tools for studying developmental interpretability in neural networks.☆95Updated this week
- ☆34Updated 6 months ago
- Code to reproduce data for Bias in Bios☆46Updated 2 years ago
- ☆26Updated 2 years ago
- A python package for benchmarking interpretability techniques on Transformers.☆213Updated 8 months ago
- diagNNose is a Python library that facilitates a broad set of tools for analysing hidden activations of neural models.☆82Updated last year
- Utilities for the HuggingFace transformers library☆68Updated 2 years ago