Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
☆35Feb 13, 2018Updated 8 years ago
Alternatives and similar repositories for spark-on-k8s-gcp-examples
Users that are interested in spark-on-k8s-gcp-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Kubernetes deployment of PrestoDB, Hive Metastore, and Minio S3-standard object store☆17Oct 20, 2022Updated 3 years ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆11Jul 13, 2023Updated 3 years ago
- Cloud Spanner Connector for Apache Spark☆18Jul 21, 2026Updated last week
- Go Client for Hive Metastore☆14Dec 18, 2022Updated 3 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Sep 5, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Hive Storage Handler for interoperability between BigQuery and Apache Hive☆19Jan 29, 2025Updated last year
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Sep 29, 2018Updated 7 years ago
- Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.☆292Updated this week
- Highly configurable Helm Presto Chart☆24Nov 13, 2019Updated 6 years ago
- Combination of Dockerized Hortonworks projects and other Hadoop ecosystem components☆10Oct 11, 2019Updated 6 years ago
- Question and Answer application using AWS Bedrock, AWS ECS, Langchain, Qdrant, and FastAPI☆15Feb 27, 2024Updated 2 years ago
- Compose minio + kafka for bucket notifications☆14Jun 16, 2021Updated 5 years ago
- spot-instance-advisor is command line tool to get the cheapest group of spot instanceTypes.☆24Mar 13, 2020Updated 6 years ago
- ☆31Mar 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Jul 2, 2026Updated 3 weeks ago
- Ctrip Data Infrastructure team works for hue☆16Dec 10, 2014Updated 11 years ago
- HDFS Automatic Snapshot Service for Linux☆11Oct 17, 2016Updated 9 years ago
- Docker packaging for Apache Flink☆139Feb 4, 2020Updated 6 years ago
- A curated list of awesome PrestoDB / Trino software, libraries, tools and resources☆18Jun 28, 2021Updated 5 years ago
- Load data in BigQuery using Cloud Workflows, Firestore and Cloud Functions.☆11May 12, 2021Updated 5 years ago
- ☆11Jun 4, 2021Updated 5 years ago
- Tutorials, Examples about Kubeflow Pipeline.☆13Nov 21, 2022Updated 3 years ago
- A book about Maven in the style of the Pragmatic Guides published by The Pragmatic Bookshelf☆11Dec 12, 2015Updated 10 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆425Updated this week
- Konzepte von Core-Java 8 werden durch beispiele illustriert. Java 8's core concepts are explained by examples.☆12Oct 12, 2018Updated 7 years ago
- Prescriptive Applications over Kite and Hadoop☆12Oct 14, 2015Updated 10 years ago
- S2X (SPARQL on Spark with GraphX) is a SPARQL query processor for Hadoop based on Spark GraphX. It combines graph-parallel abstraction of…☆15Jun 12, 2018Updated 8 years ago
- Convenient Dataflow pipelines for transforming data between cloud data sources☆24Feb 14, 2024Updated 2 years ago
- Example Apache Flink cluster on Kubernetes☆21Aug 22, 2018Updated 7 years ago
- Global package for Cloud Management in Python☆15Apr 13, 2026Updated 3 months ago
- Examples for how to use the Flink Docker images in a variety of ways☆91Oct 12, 2021Updated 4 years ago
- Flink image for Kubernetes that fixes Jobmanage connection issue☆26Jul 31, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Kubernetes API client library☆11Mar 21, 2019Updated 7 years ago
- Minikube for big data with Scala and Spark☆15Oct 28, 2019Updated 6 years ago
- Kubernetes integrity checker☆10Dec 18, 2018Updated 7 years ago
- ☆14May 27, 2022Updated 4 years ago
- Hadoop YARN & MapReduce Memory Calculator☆13Nov 9, 2015Updated 10 years ago
- Docker Image for Kudu☆37Feb 20, 2019Updated 7 years ago
- Enable Falco to read audit logs from EKS☆11Dec 13, 2020Updated 5 years ago