Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
☆241May 12, 2023Updated 3 years ago
Alternatives and similar repositories for swarm-jax
Users that are interested in swarm-jax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Contrastive Language-Image Pretraining☆148Sep 6, 2022Updated 4 years ago
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12May 24, 2021Updated 5 years ago
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆560Oct 15, 2026Updated last week
- JMP is a Mixed Precision library for JAX.☆214Oct 5, 2026Updated 3 weeks ago
- ☆958Oct 7, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Model parallel transformers in JAX and Haiku☆6,386Jan 21, 2023Updated 3 years ago
- CLU lets you write beautiful training loops in JAX.☆371Oct 7, 2026Updated 3 weeks ago
- Machine Learning eXperiment Utilities☆48Jul 29, 2025Updated last year
- A JAX implementation of stochastic addition.☆13Aug 15, 2022Updated 4 years ago
- Python Research Framework☆107Nov 3, 2022Updated 3 years ago
- A High Level API for Deep Learning in JAX☆470Dec 15, 2022Updated 3 years ago
- Train very large language models in Jax.☆209Oct 21, 2023Updated 3 years ago
- JAX-based neural network library☆3,298Updated this week
- jax-triton contains integrations between JAX and OpenAI Triton☆473Oct 20, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Dec 21, 2021Updated 4 years ago
- JAX Synergistic Memory Inspector☆187Jul 16, 2024Updated 2 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆718Jan 26, 2026Updated 9 months ago
- PIX is an image processing library in JAX, for JAX.☆452Updated this week
- A GPT, made only of MLPs, in Jax☆59Jun 23, 2021Updated 5 years ago
- A simple, performant, and scalable Jax LLM!☆2,453Updated this week
- Memory-efficient transformer. Work in progress.☆19Sep 17, 2022Updated 4 years ago
- A Pytree Module system for Deep Learning in JAX☆210Feb 26, 2023Updated 3 years ago
- A library for distributed ML training with PyTorch☆366Dec 12, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆62Mar 4, 2022Updated 4 years ago
- Implementation of VQ-VAE with a GPT-style sampler in the JAX and Haiku ecosystem.☆11Nov 23, 2023Updated 2 years ago
- ☆3,004Aug 3, 2026Updated 2 months ago
- Hardware accelerated, batchable and differentiable optimizers in JAX.☆1,067Oct 16, 2026Updated last week
- Optax is a gradient processing and optimization library for JAX.☆2,359Updated this week
- A platform for managing machine learning experiments☆924Updated this week
- Use Jax functions in Pytorch☆263Jul 1, 2023Updated 3 years ago
- Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/☆2,995Updated this week
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- JAX - A curated list of resources https://github.com/google/jax☆2,168Jan 20, 2026Updated 9 months ago
- ☆1,449Sep 9, 2026Updated last month
- Implementation of Flash Attention in Jax☆230Mar 1, 2024Updated 2 years ago
- Tools for JAX☆51Updated this week
- JAX implementation of the Llama 2 model☆217Feb 2, 2024Updated 2 years ago
- ☆91Sep 19, 2022Updated 4 years ago
- Zero-copy MPI communication of JAX arrays, for turbo-charged HPC applications in Python☆550Updated this week