GoogleCloudPlatform / ml-testing-accelerators
Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)
☆64Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for ml-testing-accelerators
- A simplified and automated orchestration workflow to perform ML end-to-end (E2E) model tests and benchmarking on Cloud VMs across differe…☆27Updated this week
- ☆122Updated this week
- This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic …☆83Updated this week
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆41Updated 2 weeks ago
- Common code for TFX☆64Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆236Updated this week
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆81Updated this week
- PyTorch RFCs (experimental)☆130Updated 2 months ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆146Updated this week
- struct2tensor is a library for parsing and manipulating structured data inside of tensorflow.☆34Updated last month
- MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.☆154Updated 2 months ago
- Distributed preprocessing and data loading for language datasets☆39Updated 7 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆331Updated last week
- ☆177Updated last week
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆98Updated 2 months ago
- A tensor-aware point-to-point communication primitive for machine learning☆249Updated last year
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆457Updated last week
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆38Updated last month
- ☆268Updated this week
- Scoreboard for ONNX Backend Compatibility☆27Updated this week
- Home for OctoML PyTorch Profiler☆107Updated last year
- Stores documents and resources used by the OpenXLA developer community☆107Updated 3 months ago
- ☆12Updated last week
- Composable metric reporters in Python.☆12Updated 5 months ago
- This repository compiles prescriptive guidance and code samples for the operationalization of NVIDIA Merlin framework on Google Cloud Ver…☆34Updated 2 years ago
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆271Updated this week
- Backward compatible ML compute opset inspired by HLO/MHLO☆412Updated this week
- Orbax provides common checkpointing and persistence utilities for JAX users☆303Updated this week
- A schedule language for large model training☆141Updated 5 months ago