Minimal library to train LLMs on TPU in JAX with pjit().
☆301Jun 2, 2026Updated 5 months ago
Alternatives and similar repositories for jaxformer
Users that are interested in jaxformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Train very large language models in Jax.☆209Oct 21, 2023Updated 3 years ago
- CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.☆5,182Jun 2, 2026Updated 5 months ago
- generative language model training on top of the JAX and Huggingface 🤗☆10May 11, 2022Updated 4 years ago
- ☆62Mar 4, 2022Updated 4 years ago
- This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (Neur…☆579Jun 2, 2026Updated 5 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆720Jan 26, 2026Updated 9 months ago
- Implementation of Flash Attention in Jax☆229Mar 1, 2024Updated 2 years ago
- jax-triton contains integrations between JAX and OpenAI Triton☆478Updated this week
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆561Oct 26, 2026Updated 3 weeks ago
- ☆372Apr 12, 2024Updated 2 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆189Jun 24, 2022Updated 4 years ago
- A simple, performant, and scalable Jax LLM!☆2,465Updated this week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,516Aug 13, 2024Updated 2 years ago
- JMP is a Mixed Precision library for JAX.☆214Oct 5, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆201Updated this week
- Inference code for LLaMA models in JAX☆120May 21, 2024Updated 2 years ago
- ☆16Jul 8, 2024Updated 2 years ago
- Tensor Parallelism with JAX + Shard Map☆11Sep 29, 2023Updated 3 years ago
- Task-based datasets, preprocessing, and evaluation for sequence models.☆596Nov 9, 2026Updated last week
- Machine Learning eXperiment Utilities☆48Jul 29, 2025Updated last year
- ☆28Nov 18, 2022Updated 4 years ago
- ☆78Dec 7, 2023Updated 2 years ago
- Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes☆20May 30, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- JAX Synergistic Memory Inspector☆187Jul 16, 2024Updated 2 years ago
- Generative model for code infilling and synthesis☆314Sep 9, 2023Updated 3 years ago
- A JAX implementation of stochastic addition.☆13Aug 15, 2022Updated 4 years ago
- CLU lets you write beautiful training loops in JAX.☆371Oct 26, 2026Updated 3 weeks ago
- ☆131Jun 9, 2022Updated 4 years ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆241May 12, 2023Updated 3 years ago
- CodeGen2 models for program synthesis☆268Jun 2, 2026Updated 5 months ago
- ☆3,007Aug 3, 2026Updated 3 months ago
- LoRA for arbitrary JAX models and functions☆143Feb 26, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- APPS: Automated Programming Progress Standard (NeurIPS 2021)☆543Jun 19, 2024Updated 2 years ago
- A simple library for scaling up JAX programs☆149Nov 4, 2025Updated last year
- Training and serving large-scale neural networks with auto parallelization.☆3,177Dec 9, 2023Updated 2 years ago
- CodeXGLUE☆1,845Apr 23, 2024Updated 2 years ago
- Standalone pre-training recipe with JAX+Flax☆35Apr 3, 2023Updated 3 years ago
- JAX implementation ViT-VQGAN☆82Sep 21, 2022Updated 4 years ago
- JAX implementation of the Mistral 7b v0.2 model☆35Jul 3, 2024Updated 2 years ago
Are these results useful?