Alternatives and similar repositories for spark-on-k8s-gcp-examples

Users that are interested in spark-on-k8s-gcp-examples are comparing it to the libraries listed below

• UrbanOS-Public / kdp

  View on GitHub
  Kubernetes deployment of PrestoDB, Hive Metastore, and Minio S3-standard object store
  ☆17Oct 20, 2022Updated 3 years ago
• GoogleCloudPlatform / datacatalog-tag-history

  View on GitHub
  Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quali…
  ☆13Jul 21, 2021Updated 4 years ago
• jdye64 / docker-hwx

  View on GitHub
  Combination of Dockerized Hortonworks projects and other Hadoop ecosystem components
  ☆10Oct 11, 2019Updated 6 years ago
• wiwdata / presto-chart

  View on GitHub
  Highly configurable Helm Presto Chart
  ☆24Nov 13, 2019Updated 6 years ago
• full360 / glue-sneaql-demo

  View on GitHub
  ☆12Mar 31, 2021Updated 4 years ago
• jpplayer / hdfs-auto-snapshot

  View on GitHub
  HDFS Automatic Snapshot Service for Linux
  ☆11Oct 17, 2016Updated 9 years ago
• XavientInformationSystems / CDS

  View on GitHub
  Content Data Store (HDFS/HBase)
  ☆13Dec 1, 2016Updated 9 years ago
• harshavardhana / minio-kafka

  View on GitHub
  Compose minio + kafka for bucket notifications
  ☆14Jun 16, 2021Updated 4 years ago
• alexvanboxel / airflow-gcp-k8s

  View on GitHub
  ☆54Aug 3, 2017Updated 8 years ago
• miguel10 / YARN-Memory-Calculator

  View on GitHub
  Hadoop YARN & MapReduce Memory Calculator
  ☆13Nov 9, 2015Updated 10 years ago
• spilth / maven-book

  View on GitHub
  A book about Maven in the style of the Pragmatic Guides published by The Pragmatic Bookshelf
  ☆11Dec 12, 2015Updated 10 years ago
• tzolov / zeppelin-ambari-plugin

  View on GitHub
  Apache Zeppelin Service for Apache Ambari Service. Installation and management of Zeppelin via Ambari.
  ☆14Jan 23, 2016Updated 10 years ago
• GoogleCloudDataproc / hive-bigquery-storage-handler

  View on GitHub
  Hive Storage Handler for interoperability between BigQuery and Apache Hive
  ☆19Jan 29, 2025Updated last year
• sainib / hadoop-data-pipeline

  View on GitHub
  Hadoop Data Pipeline using Falcon
  ☆15May 3, 2016Updated 9 years ago
• aperepel / nifi-workshop

  View on GitHub
  A complete custom processor project, for your reference.
  ☆17Sep 29, 2015Updated 10 years ago
• thiagodiogo / presto-on-kubernetes

  View on GitHub
  Presto cluster on top of kubernetes
  ☆18Jul 7, 2019Updated 6 years ago
• deric / kafka-manager-docker

  View on GitHub
  kafka-manager in Docker container
  ☆19Dec 23, 2020Updated 5 years ago
• alexjbush / ansible-hadoop-asap

  View on GitHub
  Ansible playbook for automated HDP 2.x deployment install with Kerberos
  ☆19Sep 8, 2016Updated 9 years ago
• polleyg / gcp-batch-ingestion-bigquery

  View on GitHub
  Uses Cloud Build to deploy a scalable batch ingestion pipeline consisting of GCS, Cloud Functions, Dataflow and BigQuery
  ☆22Dec 7, 2022Updated 3 years ago
• ocadotechnology / gcp-census

  View on GitHub
  [DEPRECATED] GAE python based app which regularly collects information about GCP resources and stores them in BigQuery
  ☆45Aug 31, 2023Updated 2 years ago
• docker-flink / examples

  View on GitHub
  Examples for how to use the Flink Docker images in a variety of ways
  ☆91Oct 12, 2021Updated 4 years ago
• gluster / glusterfs-hadoop

  View on GitHub
  GlusterFS plugin for Hadoop HCFS
  ☆69Apr 12, 2022Updated 3 years ago
• cartershanklin / csv-to-orc

  View on GitHub
  Convert a CSV fle to ORCFile
  ☆26Apr 10, 2019Updated 6 years ago
• lintool / SparkTutorial

  View on GitHub
  Spark Tutorial at the University of Maryland
  ☆38Oct 24, 2014Updated 11 years ago
• hortonworks-gallery / ambari-iframe-view

  View on GitHub
  Embed any webapp/website as Ambari view!
  ☆25Feb 26, 2016Updated 9 years ago
• ThaminduR / spark-privacy-preserver

  View on GitHub
  Anonymizing Library for Apache Spark
  ☆31Nov 9, 2023Updated 2 years ago
• google-marketing-solutions / argon

  View on GitHub
  Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector
  ☆37Apr 18, 2023Updated 2 years ago
• googleapis / java-bigquerystorage

  View on GitHub
  ☆75Updated this week
• hoch / motw-2015

  View on GitHub
  Boilerplate project for MOTW Workshop 2015
  ☆10Mar 3, 2016Updated 9 years ago
• mdouchement / docker-hdfs

  View on GitHub
  Docker image for single HDFS node
  ☆27Sep 27, 2018Updated 7 years ago
• gesellix / inject-docker-certs

  View on GitHub
  Adding certificates to the Docker for Mac beta
  ☆28Nov 30, 2016Updated 9 years ago
• samelamin / spark-bigquery

  View on GitHub
  Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
  ☆70May 8, 2023Updated 2 years ago
• LucasRoesler / openfaas-loki

  View on GitHub
  Loki log provider for OpenFaaS
  ☆27Jan 12, 2024Updated 2 years ago
• prestodb / docker-images

  View on GitHub
  Docker images for Presto integration testing
  ☆35Jul 15, 2025Updated 7 months ago
• GoogleCloudDataproc / hadoop-connectors

  View on GitHub
  Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
  ☆289Updated this week
• GoogleCloudPlatform / airflow-operator

  View on GitHub
  Kubernetes custom controller and CRDs to managing Airflow
  ☆298Jun 25, 2020Updated 5 years ago
• qut-dmrc / DMRC_Academic_Twitter_Archive_Collector

  View on GitHub
  Uses Twarc 2 to access Twitter's archive via the API 2.0. Collects, processes and pushes Tweets to a specified Google BigQuery dataset. R…
  ☆12Apr 5, 2023Updated 2 years ago
• eyala / pig-eclipse

  View on GitHub
  Apache Pig plugin for Eclipse
  ☆12Feb 28, 2017Updated 8 years ago
• TIBCOSoftware / snappy-on-k8s

  View on GitHub
  An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes
  ☆84Mar 16, 2020Updated 5 years ago