AI-Hypercomputer / ml-goodput-measurement
☆12Updated 2 weeks ago
Alternatives and similar repositories for ml-goodput-measurement:
Users that are interested in ml-goodput-measurement are comparing it to the libraries listed below
- Experimenting with how best to do multi-host dataloading☆10Updated 2 years ago
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆103Updated this week
- T5Patches is a set of tools for fast and targeted editing of generative language models built with T5X.☆12Updated 8 months ago
- Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.☆34Updated last week
- ☆134Updated 2 weeks ago
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆51Updated last week
- ☆14Updated this week
- A simplified and automated orchestration workflow to perform ML end-to-end (E2E) model tests and benchmarking on Cloud VMs across differe…☆35Updated this week
- ☆40Updated 2 weeks ago
- struct2tensor is a library for parsing and manipulating structured data inside of tensorflow.☆34Updated this week
- Two implementations of ZeRO-1 optimizer sharding in JAX☆13Updated last year
- ☆24Updated this week
- ☆17Updated 9 months ago
- Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)☆64Updated 2 months ago
- This repo contains the code associated to the paper: "Constrained Causal Bayesian Optimization" by Aglietti Virginia, Alan Malek, Ira Kt…☆16Updated 8 months ago
- ☆34Updated last year
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆275Updated this week
- Causal Analysis of Agent Behavior for AI Safety☆17Updated last year
- AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…☆279Updated this week
- Machine Learning eXperiment Utilities☆46Updated 8 months ago
- ☆24Updated this week
- Composable metric reporters in Python.☆13Updated 8 months ago
- ☆14Updated 9 months ago
- ☆14Updated last month
- JAX Implementation of Black Forest Labs' Flux.1 family of models☆29Updated 3 months ago
- Modular, scalable library to train ML models☆60Updated this week
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆89Updated this week
- ☆26Updated last year
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆107Updated 3 weeks ago
- Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.☆23Updated 4 months ago