irregular-rhomboid / EAI-Math-Reading-Group
Resources from the EleutherAI Math Reading Group
β52Updated last month
Alternatives and similar repositories for EAI-Math-Reading-Group:
Users that are interested in EAI-Math-Reading-Group are comparing it to the libraries listed below
- 𧱠Modula software packageβ132Updated this week
- β201Updated 6 months ago
- π§ Starter templates for doing interpretability researchβ64Updated last year
- supporting pytorch FSDP for optimizersβ75Updated last month
- Large scale 4D parallelism pre-training for π€ transformers in Mixture of Experts *(still work in progress)*β81Updated last year
- A MAD laboratory to improve AI architecture designs π§ͺβ102Updated last month
- An interactive exploration of Transformer programming.β255Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.β90Updated last month
- Neural Networks and the Chomsky Hierarchyβ192Updated 9 months ago
- LoRA for arbitrary JAX models and functionsβ135Updated 10 months ago
- β75Updated 6 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)β182Updated 7 months ago
- A puzzle to learn about promptingβ123Updated last year
- JAX implementation of the Llama 2 modelβ213Updated 11 months ago
- Sparse and discrete interpretability tool for neural networksβ58Updated 11 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT trainingβ121Updated 9 months ago
- we got you broβ33Updated 5 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditionβ¦β146Updated last month
- A case study of efficient training of large language models using commodity hardware.β68Updated 2 years ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).β176Updated last month
- Named Tensors for Legible Deep Learning in JAXβ157Updated last week
- JAX Synergistic Memory Inspectorβ164Updated 6 months ago
- Erasing concepts from neural representations with provable guaranteesβ219Updated last month
- Running Jax in PyTorch Lightningβ83Updated last month
- A simple library for scaling up JAX programsβ129Updated 2 months ago
- Neural Networks for JAXβ83Updated 3 months ago
- β58Updated 2 years ago
- β114Updated last year
- HomebrewNLP in JAX flavour for maintable TPU-Trainingβ47Updated 11 months ago