srush / anynp
Proof-of-concept of global switching between numpy/jax/pytorch in a library.
☆18Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for anynp
- ☆18Updated 6 months ago
- Experiment of using Tangent to autodiff triton☆71Updated 9 months ago
- JAX implementation of the Mistral 7b v0.2 model☆33Updated 4 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆95Updated 6 months ago
- some common Huggingface transformers in maximal update parametrization (µP)☆76Updated 2 years ago
- This is a port of Mistral-7B model in JAX☆30Updated 4 months ago
- Personal solutions to the Triton Puzzles☆15Updated 3 months ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 6 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆83Updated last week
- Make triton easier☆41Updated 4 months ago
- A simple library for scaling up JAX programs☆125Updated last week
- Experiments for efforts to train a new and improved t5☆76Updated 6 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆78Updated 9 months ago
- ☆13Updated 4 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated last week
- ☆46Updated last month
- ☆58Updated 2 years ago
- Scalable neural net training via automatic normalization in the modular norm.☆118Updated 2 months ago
- train with kittens!☆48Updated 2 weeks ago
- gzip Predicts Data-dependent Scaling Laws☆32Updated 5 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆43Updated this week
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago
- ML/DL Math and Method notes☆57Updated 11 months ago
- ☆17Updated 2 weeks ago
- Silly twitter torch implementations.☆46Updated 2 years ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆80Updated 10 months ago
- ☆50Updated 5 months ago
- Code associated to papers on superposition (in ML interpretability)☆24Updated 2 years ago
- ☆20Updated last year