Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
☆117Updated this week
Alternatives and similar repositories for gpu-recipes
Users that are interested in gpu-recipes are comparing it to the libraries listed below
Sorting:
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆169Feb 20, 2026Updated last week
- Cluster Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy AI/ML and HPC environments…☆322Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆413Jan 5, 2026Updated last month
- ☆16Mar 13, 2025Updated 11 months ago
- CUDA Template Functions☆20Dec 16, 2025Updated 2 months ago
- Repository for go shared libraries (for now).☆11Dec 1, 2025Updated 2 months ago
- Training NVIDIA NeMo Megatron Large Language Model (LLM) using NeMo Framework on Google Kubernetes Engine☆16Apr 28, 2025Updated 10 months ago
- Make tool-calling schemas for existing tools☆14Mar 8, 2025Updated 11 months ago
- ☆61Updated this week
- AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…☆327Jun 23, 2025Updated 8 months ago
- A Template for MLOps on Google Cloud Vertex AI☆13Mar 16, 2022Updated 3 years ago
- ☆42Feb 10, 2026Updated 2 weeks ago
- TPU inference for vLLM, with unified JAX and PyTorch support.☆243Updated this week
- This repository compiles code samples and notebooks demonstrating how to use Generative AI on Google Cloud Vertex AI.☆826Jan 6, 2026Updated last month
- ☆314Updated this week
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆79Dec 18, 2025Updated 2 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆20Oct 23, 2023Updated 2 years ago
- A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.☆861Updated this week
- ☆32Oct 31, 2025Updated 4 months ago
- ☆21Mar 3, 2025Updated 11 months ago
- ☆24May 1, 2024Updated last year
- A simple, performant and scalable Jax LLM!☆2,148Updated this week
- Scripts and YAML files for the Bank of Anthos sample application☆23Dec 14, 2023Updated 2 years ago
- FP4 MAC Array☆19Apr 14, 2024Updated last year
- tenstorrent kernel from twitch☆28Mar 16, 2024Updated last year
- Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)☆64Feb 5, 2026Updated 3 weeks ago
- 🚀✨ Help subscribers understand Python + AI https://www.youtube.com/playlist?list=PLTV_nsuD2lf7JOwZdSWuup-YO0AUaDQti☆99Jan 26, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆53Dec 11, 2023Updated 2 years ago
- Create a secure ML environment on Vertex AI☆32Feb 5, 2026Updated 3 weeks ago
- torchprime is a reference model implementation for PyTorch on TPU.☆46Feb 18, 2026Updated last week
- Sample applications and demos for Document AI, the end-to-end document processing platform on Google Cloud☆307Jan 5, 2026Updated last month
- Deploy VPC Network Tester to App Engine or Cloud Run to investigate the traffic flow. This app demonstrates how to package network tools …☆32Sep 28, 2020Updated 5 years ago
- Identify and tokenize sensitive data automatically using Cloud DLP and Dataflow☆45Oct 27, 2025Updated 4 months ago
- ☆39Updated this week
- ☆151Feb 12, 2026Updated 2 weeks ago
- Tokamax: A GPU and TPU kernel library.☆176Feb 21, 2026Updated last week
- ☆10Jul 12, 2017Updated 8 years ago
- EdgeCortix maintained and extended fork of Apache TVM compiler stack utilized by MERA framework. TVM is an open deep learning compiler st…☆11Dec 22, 2023Updated 2 years ago
- Build an AI bot in Discord to serve user's personalized reports on what's up in tech☆28Sep 14, 2025Updated 5 months ago