Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
☆241May 12, 2023Updated 2 years ago
Alternatives and similar repositories for swarm-jax
Users that are interested in swarm-jax are comparing it to the libraries listed below
Sorting:
- Contrastive Language-Image Pretraining☆144Sep 6, 2022Updated 3 years ago
- Train very large language models in Jax.☆210Oct 21, 2023Updated 2 years ago
- JMP is a Mixed Precision library for JAX.☆211Jan 30, 2025Updated last year
- ☆927Jan 29, 2026Updated last month
- A JAX implementation of stochastic addition.☆14Aug 15, 2022Updated 3 years ago
- Model parallel transformers in JAX and Haiku☆6,363Jan 21, 2023Updated 3 years ago
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆550Feb 26, 2026Updated last week
- JAX-based neural network library☆3,193Mar 2, 2026Updated last week
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12May 24, 2021Updated 4 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆695Jan 26, 2026Updated last month
- Python Research Framework☆106Nov 3, 2022Updated 3 years ago
- Machine Learning eXperiment Utilities☆48Jul 29, 2025Updated 7 months ago
- CLU lets you write beautiful training loops in JAX.☆367Mar 3, 2026Updated last week
- A High Level API for Deep Learning in JAX☆476Dec 15, 2022Updated 3 years ago
- A library for distributed ML training with PyTorch☆366Dec 12, 2022Updated 3 years ago
- jax-triton contains integrations between JAX and OpenAI Triton☆439Feb 27, 2026Updated last week
- PIX is an image processing library in JAX, for JAX.☆434Mar 6, 2025Updated last year
- JAX Synergistic Memory Inspector☆184Jul 16, 2024Updated last year
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Dec 21, 2021Updated 4 years ago
- Implementation of VQ-VAE with a GPT-style sampler in the JAX and Haiku ecosystem.☆12Nov 23, 2023Updated 2 years ago
- Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/☆2,803Updated this week
- A simple, performant and scalable Jax LLM!☆2,163Updated this week
- ☆1,409Mar 2, 2026Updated last week
- Hardware accelerated, batchable and differentiable optimizers in JAX.☆1,028Dec 17, 2025Updated 2 months ago
- Optax is a gradient processing and optimization library for JAX.☆2,198Feb 26, 2026Updated last week
- JAX - A curated list of resources https://github.com/google/jax☆2,065Jan 20, 2026Updated last month
- Dense Passage Retrieval using tensorflow-keras on TPU☆17Jun 27, 2021Updated 4 years ago
- A platform for managing machine learning experiments☆898Updated this week
- ☆2,950Jan 15, 2026Updated last month
- JAX implementation of the Llama 2 model☆216Feb 2, 2024Updated 2 years ago
- LoRA for arbitrary JAX models and functions☆145Feb 26, 2024Updated 2 years ago
- ☆91Sep 19, 2022Updated 3 years ago
- ☆18Aug 24, 2024Updated last year
- Train vision models using JAX and 🤗 transformers☆100Dec 14, 2025Updated 2 months ago
- A Pytree Module system for Deep Learning in JAX☆213Feb 26, 2023Updated 3 years ago
- ☆55Aug 9, 2024Updated last year
- ☆624Jan 23, 2026Updated last month
- Documentation:☆129May 22, 2023Updated 2 years ago
- Extending JAX with custom C++ and CUDA code☆403Aug 18, 2024Updated last year