fattorib / transformer_shmap
Tensor Parallelism with JAX + Shard Map
☆10Updated 11 months ago
Related projects: ⓘ
- ESM2 protein language models in JAX/Flax☆15Updated last year
- Turn jitted jax functions back into python source code☆20Updated 2 months ago
- Lightning-like training API for JAX with Flax☆28Updated 4 months ago
- Einsum-like high-level array sharding API for JAX☆31Updated 2 months ago
- A selection of neural network models ported from torchvision for JAX & Flax.☆44Updated 3 years ago
- This is a port of Mistral-7B model in JAX☆29Updated 2 months ago
- Experiment of using Tangent to autodiff triton☆66Updated 7 months ago
- Pytorch-like dataloaders in JAX.☆52Updated last month
- Dive into Jax, Flax, XLA and C++☆31Updated 4 years ago
- Personal solutions to the Triton Puzzles☆11Updated 2 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆74Updated 7 months ago
- A minimal implementation of a VAE with BinConcrete (relaxed Bernoulli) latent distribution in TensorFlow.☆21Updated 4 years ago
- ☆78Updated 3 years ago
- Jax/Flax rewrite of Karpathy's nanoGPT☆46Updated last year
- A simple library for scaling up JAX programs☆116Updated last month
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated last year
- ☆28Updated this week
- ☆27Updated this week
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆34Updated 2 months ago
- Silly twitter torch implementations.☆46Updated last year
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆57Updated last month
- ☆33Updated 3 years ago
- ☆17Updated 4 months ago
- A port of muP to JAX/Haiku☆25Updated last year
- ☆24Updated 5 years ago
- JMP is a Mixed Precision library for JAX.☆183Updated 4 months ago
- Fine-grained, dynamic control of neural network topology in JAX.☆21Updated last year
- Jupyter Notebook corresponding to 'Going with the Flow: An Introduction to Normalizing Flows'☆25Updated 3 years ago
- Visualize, create, and operate on pytrees in the most intuitive way possible.☆39Updated 11 months ago
- Blog post☆16Updated 7 months ago