Alternatives and similar repositories for airflow_hive_spark_sqoop:

Users that are interested in airflow_hive_spark_sqoop are comparing it to the libraries listed below

• pavank / docker-bigdata-cluster
  Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host
  ☆20Updated 6 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆256Updated last year
• myamafuj / hadoop-hive-spark-docker
  Hadoop-Hive-Spark cluster + Jupyter on Docker
  ☆74Updated 4 months ago
• panovvv / hadoop-hive-spark-docker
  Base Docker image with just essentials: Hadoop, Hive and Spark.
  ☆69Updated 4 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated last week
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆114Updated 5 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆122Updated last year
• LearningJournal / Spark-Streaming-In-Scala
  Apache Spark 3 - Structured Streaming Course Material
  ☆45Updated 4 years ago
• ongxuanhong / de02-pyspark-optimization
  ☆14Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆54Updated 2 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆144Updated 4 years ago
• sparkbyexamples / spark-examples
  Spark Examples
  ☆125Updated 3 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆102Updated 10 months ago
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆38Updated 4 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated this week
• delta-io / delta-examples
  Delta Lake examples
  ☆224Updated 7 months ago
• kaoutaar / end-to-end-etl-pipeline-jcdecaux-API
  velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…
  ☆18Updated 7 months ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆98Updated 2 years ago
• bitsondatadev / trino-getting-started
  ☆265Updated 6 months ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆45Updated last year
• LearningJournal / SparkProgrammingInScala
  Apache Spark Course Material
  ☆89Updated 2 years ago
• marclamberti / airflow-materials-aws
  Materials for the next course
  ☆24Updated 2 years ago
• derar-alhussein / Databricks-Certified-Data-Engineer-Professional
  The resources of the preparation course for Databricks Data Engineer Professional certification exam
  ☆113Updated last month
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆69Updated last year
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆136Updated 5 years ago
• developershomes / SparkETL
  Spark all the ETL Pipelines
  ☆32Updated last year
• sdesilva26 / docker-spark
  Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
  ☆130Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• indiacloudtv / structuredstreamingkafkapyspark
  Apche Spark Structured Streaming with Kafka using Python(PySpark)
  ☆40Updated 5 years ago