srush / anynp
Proof-of-concept of global switching between numpy/jax/pytorch in a library.
☆18Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for anynp
- ☆19Updated 6 months ago
- Experiment of using Tangent to autodiff triton☆72Updated 9 months ago
- This is a port of Mistral-7B model in JAX☆30Updated 4 months ago
- JAX implementation of the Mistral 7b v0.2 model☆33Updated 4 months ago
- some common Huggingface transformers in maximal update parametrization (µP)☆76Updated 2 years ago
- Jax like function transformation engine but micro, microjax☆26Updated 3 weeks ago
- A MAD laboratory to improve AI architecture designs 🧪☆95Updated 6 months ago
- Personal solutions to the Triton Puzzles☆16Updated 4 months ago
- train with kittens!☆49Updated 3 weeks ago
- Silly twitter torch implementations.☆46Updated 2 years ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated 2 weeks ago
- ☆58Updated 2 years ago
- gzip Predicts Data-dependent Scaling Laws☆32Updated 5 months ago
- Automatically take good care of your preemptible TPUs☆32Updated last year
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆80Updated 11 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆79Updated 9 months ago
- ☆13Updated 4 months ago
- Scalable neural net training via automatic normalization in the modular norm.☆121Updated 3 months ago
- Code for minimum-entropy coupling.☆30Updated 4 months ago
- ML/DL Math and Method notes☆57Updated 11 months ago
- Einsum-like high-level array sharding API for JAX☆32Updated 4 months ago
- Graph neural networks in JAX.☆67Updated 5 months ago
- Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.☆44Updated 3 years ago
- ☆46Updated last month
- ☆27Updated 4 months ago
- Make triton easier☆41Updated 5 months ago
- ☆40Updated 4 months ago
- ☆18Updated 7 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago