Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
☆241May 12, 2023Updated 3 years ago
Alternatives and similar repositories for swarm-jax
Users that are interested in swarm-jax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Contrastive Language-Image Pretraining☆146Sep 6, 2022Updated 3 years ago
- JMP is a Mixed Precision library for JAX.☆213Jan 30, 2025Updated last year
- Machine Learning eXperiment Utilities☆48Jul 29, 2025Updated 10 months ago
- A JAX implementation of stochastic addition.☆14Aug 15, 2022Updated 3 years ago
- Train very large language models in Jax.☆208Oct 21, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆944Apr 10, 2026Updated last month
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12May 24, 2021Updated 5 years ago
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆554Updated this week
- Model parallel transformers in JAX and Haiku☆6,374Jan 21, 2023Updated 3 years ago
- JAX-based neural network library☆3,236Updated this week
- Python Research Framework☆107Nov 3, 2022Updated 3 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆709Jan 26, 2026Updated 4 months ago
- JAX Synergistic Memory Inspector☆186Jul 16, 2024Updated last year
- jax-triton contains integrations between JAX and OpenAI Triton☆461Jun 1, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A High Level API for Deep Learning in JAX☆473Dec 15, 2022Updated 3 years ago
- CLU lets you write beautiful training loops in JAX.☆366Mar 3, 2026Updated 3 months ago
- Implementation of VQ-VAE with a GPT-style sampler in the JAX and Haiku ecosystem.☆11Nov 23, 2023Updated 2 years ago
- PIX is an image processing library in JAX, for JAX.☆439Updated this week
- A GPT, made only of MLPs, in Jax☆59Jun 23, 2021Updated 4 years ago
- A library for distributed ML training with PyTorch☆365Dec 12, 2022Updated 3 years ago
- Hardware accelerated, batchable and differentiable optimizers in JAX.☆1,040Updated this week
- A simple, performant and scalable Jax LLM!☆2,304Updated this week
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Dec 21, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/☆2,896May 22, 2026Updated 2 weeks ago
- ☆62Mar 4, 2022Updated 4 years ago
- ☆1,426Mar 31, 2026Updated 2 months ago
- Implementation of Flash Attention in Jax☆227Mar 1, 2024Updated 2 years ago
- JAX - A curated list of resources https://github.com/google/jax☆2,118Jan 20, 2026Updated 4 months ago
- Optax is a gradient processing and optimization library for JAX.☆2,273Jun 1, 2026Updated last week
- ☆2,966May 20, 2026Updated 2 weeks ago
- ☆56Aug 9, 2024Updated last year
- Tools for JAX☆50Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Aug 24, 2024Updated last year
- LoRA for arbitrary JAX models and functions☆144Feb 26, 2024Updated 2 years ago
- A platform for managing machine learning experiments☆912May 18, 2026Updated 3 weeks ago
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 6 months ago
- Memory-efficient transformer. Work in progress.☆19Sep 17, 2022Updated 3 years ago
- minGPT in JAX☆49Jan 10, 2022Updated 4 years ago
- Collaborative inference of latent diffusion via hivemind☆12May 29, 2023Updated 3 years ago