enjalot / latent-sae
Training code for Sparse Autoencoders on Embedding models
☆35Updated 3 weeks ago
Alternatives and similar repositories for latent-sae:
Users that are interested in latent-sae are comparing it to the libraries listed below
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- An introduction to LLM Sampling☆77Updated 3 months ago
- NLP with Rust for Python 🦀🐍☆61Updated 9 months ago
- ☆48Updated 4 months ago
- Using modal.com to process FineWeb-edu data☆20Updated 2 weeks ago
- Latent Large Language Models☆17Updated 6 months ago
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆31Updated 3 weeks ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 11 months ago
- ☆22Updated 9 months ago
- Experiments for efforts to train a new and improved t5☆77Updated 11 months ago
- look how they massacred my boy☆63Updated 5 months ago
- ☆38Updated 7 months ago
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆27Updated 5 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- ☆48Updated last year
- ☆22Updated last year
- ☆28Updated 5 months ago
- Functional Benchmarks and the Reasoning Gap☆84Updated 5 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated this week
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆31Updated last year
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆25Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago
- utilities for loading and running text embeddings with onnx☆44Updated 7 months ago
- ☆63Updated 5 months ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆97Updated last year