justinchiu / openlogprobs
Extract full next-token probabilities via language model APIs
☆242Updated last year
Alternatives and similar repositories for openlogprobs:
Users that are interested in openlogprobs are comparing it to the libraries listed below
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆199Updated 4 months ago
- ☆130Updated last month
- Erasing concepts from neural representations with provable guarantees☆228Updated 3 months ago
- Mechanistic Interpretability Visualizations using React☆242Updated 4 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆99Updated 2 months ago
- ☆121Updated last year
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆189Updated 5 months ago
- Sparsify transformers with SAEs and transcoders☆524Updated this week
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆189Updated 11 months ago
- A puzzle to learn about prompting☆127Updated last year
- nanoGPT-like codebase for LLM training☆94Updated last month
- ☆221Updated 7 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆170Updated this week
- Understand and test language model architectures on synthetic tasks.☆194Updated last month
- A MAD laboratory to improve AI architecture designs 🧪☆113Updated 4 months ago
- ☆91Updated 2 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆105Updated this week
- Experiments for efforts to train a new and improved t5☆77Updated last year
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆150Updated this week
- ☆114Updated 9 months ago
- RuLES: a benchmark for evaluating rule-following in language models☆223Updated 2 months ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆182Updated 5 months ago
- ☆26Updated last year
- A library for efficient patching and automatic circuit discovery.☆64Updated 2 weeks ago
- Functional Benchmarks and the Reasoning Gap☆85Updated 7 months ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆267Updated 2 weeks ago
- Draw more samples☆189Updated 10 months ago
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆220Updated last year
- PyTorch library for Active Fine-Tuning☆68Updated 2 months ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆211Updated last year