JackCai1206 / arithmetic-self-improveLinks
☆34Updated 6 months ago
Alternatives and similar repositories for arithmetic-self-improve
Users that are interested in arithmetic-self-improve are comparing it to the libraries listed below
Sorting:
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆152Updated last month
- ☆138Updated 4 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆191Updated last year
- Universal Neurons in GPT2 Language Models☆30Updated last year
- ☆53Updated last year
- Applying SAEs for fine-grained control☆23Updated 8 months ago
- Sparse Autoencoder Training Library☆54Updated 3 months ago
- Understand and test language model architectures on synthetic tasks.☆221Updated last month
- nanoGPT-like codebase for LLM training☆102Updated 3 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆77Updated 8 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆124Updated 8 months ago
- ☆28Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆206Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆211Updated 8 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆58Updated 9 months ago
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆64Updated 9 months ago
- Extract full next-token probabilities via language model APIs☆247Updated last year
- Attribution-based Parameter Decomposition☆28Updated 2 months ago
- ☆32Updated last year
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆128Updated 8 months ago
- ☆67Updated last year
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆129Updated 2 years ago
- Open source interpretability artefacts for R1.☆157Updated 4 months ago
- PyTorch library for Active Fine-Tuning☆89Updated 6 months ago
- ☆54Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆150Updated 6 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆228Updated last month
- A set of Python scripts that makes your experience on TPU better☆54Updated last year
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆84Updated last month
- EvaByte: Efficient Byte-level Language Models at Scale☆107Updated 4 months ago