AakashKumarNain / mistral_jaxLinks
This is a port of Mistral-7B model in JAX
☆32Updated last year
Alternatives and similar repositories for mistral_jax
Users that are interested in mistral_jax are comparing it to the libraries listed below
Sorting:
- Implementation of Flash Attention in Jax☆219Updated last year
- LoRA for arbitrary JAX models and functions☆141Updated last year
- A functional training loops library for JAX☆88Updated last year
- Neural Networks for JAX☆84Updated last year
- JAX Implementation of Black Forest Labs' Flux.1 family of models☆39Updated last month
- A simple library for scaling up JAX programs☆144Updated 11 months ago
- ☆44Updated 2 months ago
- Experiment of using Tangent to autodiff triton☆80Updated last year
- JMP is a Mixed Precision library for JAX.☆208Updated 8 months ago
- Minimal yet performant LLM examples in pure JAX☆186Updated last month
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆88Updated last year
- ☆115Updated last month
- supporting pytorch FSDP for optimizers☆83Updated 10 months ago
- JAX implementation of the Mistral 7b v0.2 model☆35Updated last year
- Unofficial JAX implementations of deep learning research papers☆158Updated 3 years ago
- A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.☆295Updated last year
- ☆91Updated last year
- Einsum-like high-level array sharding API for JAX☆35Updated last year
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Updated last year
- Running Jax in PyTorch Lightning☆112Updated 10 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆188Updated last week
- Lightning-like training API for JAX with Flax☆44Updated 10 months ago
- ☆60Updated 3 years ago
- Explorations into the recently proposed Taylor Series Linear Attention☆99Updated last year
- ☆62Updated 3 years ago
- Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster☆71Updated 5 months ago
- If it quacks like a tensor...☆59Updated 11 months ago
- ☆218Updated 10 months ago
- JAX Synergistic Memory Inspector☆179Updated last year
- A Python package of computer vision models for the Equinox ecosystem.☆109Updated last year