☆570Jul 11, 2024Updated last year
Alternatives and similar repositories for HighPerfLLMs2024
Users that are interested in HighPerfLLMs2024 are comparing it to the libraries listed below
Sorting:
- A simple, performant and scalable Jax LLM!☆2,170Updated this week
- Minimal yet performant LLM examples in pure JAX☆245Jan 14, 2026Updated 2 months ago
- ☆306Jul 15, 2024Updated last year
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆342Updated this week
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆698Jan 26, 2026Updated last month
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆416Jan 5, 2026Updated 2 months ago
- Package of Pathways-on-Cloud utilities☆25Updated this week
- ☆350Mar 10, 2026Updated last week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆873Mar 15, 2026Updated last week
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆551Updated this week
- A simple library for scaling up JAX programs☆146Nov 4, 2025Updated 4 months ago
- A simplified and automated orchestration workflow to perform ML end-to-end (E2E) model tests and benchmarking on Cloud VMs across differe…☆61Updated this week
- Train very large language models in Jax.☆210Oct 21, 2023Updated 2 years ago
- JAX-Toolbox☆389Updated this week
- ☆318Updated this week
- Minimal but scalable implementation of large language models in JAX☆35Nov 28, 2025Updated 3 months ago
- seqax = sequence modeling + JAX☆188Jul 23, 2025Updated 7 months ago
- ☆79Updated this week
- ☆28Jun 3, 2024Updated last year
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆171Mar 13, 2026Updated last week
- torchprime is a reference model implementation for PyTorch on TPU.☆46Mar 3, 2026Updated 2 weeks ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated 7 months ago
- ☆92Jul 5, 2024Updated last year
- jax-triton contains integrations between JAX and OpenAI Triton☆442Mar 13, 2026Updated last week
- PathwaysJob API is an OSS Kubernetes-native API, to deploy ML training and batch inference workloads, using Pathways on GKE.☆19Oct 22, 2025Updated 4 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,522Aug 13, 2024Updated last year
- ☆33Feb 4, 2026Updated last month
- JAX Synergistic Memory Inspector☆185Jul 16, 2024Updated last year
- JAX bindings for Flash Attention v2☆103Feb 28, 2026Updated 3 weeks ago
- GPU programming related news and material links☆2,047Mar 8, 2026Updated last week
- A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…☆34Mar 4, 2025Updated last year
- What would you do with 1000 H100s...☆1,161Jan 10, 2024Updated 2 years ago
- A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.☆118Dec 29, 2025Updated 2 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆598Aug 12, 2025Updated 7 months ago
- Tokamax: A GPU and TPU kernel library.☆185Updated this week
- ☆275Updated this week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,116Aug 26, 2025Updated 6 months ago
- Tidy autoregressive inference in JAX☆15Sep 1, 2025Updated 6 months ago
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,873Jun 22, 2025Updated 9 months ago