AugustasMacijauskas / trailtokenLinks
An application that visualises LLM tokenizers
☆9Updated 11 months ago
Alternatives and similar repositories for trailtoken
Users that are interested in trailtoken are comparing it to the libraries listed below
Sorting:
- ☆37Updated 2 years ago
- A library for research in unnatural language semantics☆11Updated 3 weeks ago
- Seminar on Large Language Models (COMP790-101 at UNC Chapel Hill, Fall 2022)☆311Updated 2 years ago
- An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"☆317Updated 10 months ago
- ☆62Updated 3 months ago
- Embeddings: State-of-the-art Text Representations for Natural Language Processing tasks, an initial version of library focus on the Polis…☆36Updated last year
- A python sdk for LLM finetuning and inference on runpod infrastructure☆12Updated this week
- An interactive exploration of Transformer programming.☆267Updated last year
- See the issue board for the current status of active and prospective projects!☆65Updated 3 years ago
- Mechanistic Interpretability for Transformer Models☆51Updated 3 years ago
- Ember is a hosted API/SDK that lets you shape AI model behavior by directly controlling a model's internal units of computation, or "feat…☆29Updated 3 weeks ago
- natbib compatible splncs04.bst (Springer LNCS) BibTeX Style File built using a docstrip with the conventional merlin.mbs master file.☆51Updated 3 years ago
- Mechanistic Interpretability Visualizations using React☆273Updated 7 months ago
- Erasing concepts from neural representations with provable guarantees☆232Updated 6 months ago
- A collection of Italian benchmarks for LLM evaluation☆30Updated 2 months ago
- git extension for {collaborative, communal, continual} model development☆217Updated 8 months ago
- ☆80Updated 4 years ago
- Official repository for CMU Machine Learning Department's 10721: "Philosophical Foundations of Machine Intelligence".☆262Updated 2 years ago
- Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging F…☆574Updated last year
- Interpretability for sequence generation models 🐛 🔍☆432Updated 3 months ago
- Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)☆127Updated last month
- ☆540Updated last year
- Classical CHAT80 NLP system for Prolog☆22Updated 5 months ago
- ☆19Updated last year
- Polish BERT☆72Updated 4 years ago
- Extract full next-token probabilities via language model APIs☆247Updated last year
- The Happy Faces Benchmark☆15Updated 2 years ago
- Code to reproduce experiments in the paper "Constrained Language Models Yield Few-Shot Semantic Parsers" (EMNLP 2021).☆64Updated last year
- Code to reproduce data for Bias in Bios☆46Updated 2 years ago
- ☆289Updated last year