irregular-rhomboid / EAI-Math-Reading-Group
Resources from the EleutherAI Math Reading Group
โ52Updated 2 months ago
Alternatives and similar repositories for EAI-Math-Reading-Group:
Users that are interested in EAI-Math-Reading-Group are comparing it to the libraries listed below
- ๐งฑ Modula software packageโ145Updated this week
- Erasing concepts from neural representations with provable guaranteesโ222Updated 3 weeks ago
- A puzzle to learn about promptingโ124Updated last year
- An interactive exploration of Transformer programming.โ258Updated last year
- Understand and test language model architectures on synthetic tasks.โ181Updated last month
- Neural Networks and the Chomsky Hierarchyโ199Updated 10 months ago
- โ164Updated last year
- ๐ง Starter templates for doing interpretability researchโ66Updated last year
- we got you broโ35Updated 6 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paperโ112Updated 2 years ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT trainingโ122Updated 10 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)โ185Updated 8 months ago
- โ116Updated last year
- Proof-of-concept of global switching between numpy/jax/pytorch in a library.โ18Updated 8 months ago
- โ53Updated last year
- See the issue board for the current status of active and prospective projects!โ65Updated 3 years ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"โ72Updated 2 years ago
- โ211Updated 7 months ago
- โ59Updated 2 years ago
- โ26Updated last year
- Mechanistic Interpretability for Transformer Modelsโ49Updated 2 years ago
- A MAD laboratory to improve AI architecture designs ๐งชโ102Updated 2 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.โ95Updated 3 months ago
- โ75Updated 7 months ago
- LoRA for arbitrary JAX models and functionsโ135Updated 11 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).โ182Updated 2 months ago
- supporting pytorch FSDP for optimizersโ76Updated 2 months ago
- โ36Updated 2 months ago
- Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.โ46Updated 3 years ago
- Our solution for the arc challenge 2024โ103Updated 2 months ago