Alternatives and similar repositories for airflow_hive_spark_sqoop:

Users that are interested in airflow_hive_spark_sqoop are comparing it to the libraries listed below

• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆247Updated last year
• delta-io / delta-examples
  Delta Lake examples
  ☆214Updated 3 months ago
• pavank / docker-bigdata-cluster
  Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host
  ☆20Updated 6 years ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆116Updated 3 months ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆97Updated last year
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆121Updated last year
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆41Updated last year
• sungchun12 / airflow-dbt-cloud
  dbt Cloud pipelines in airflow examples
  ☆35Updated last year
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 4 years ago
• panovvv / hadoop-hive-spark-docker
  Base Docker image with just essentials: Hadoop, Hive and Spark.
  ☆68Updated 3 years ago
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆168Updated last year
• amesar / docker-spark-hive-metastore
  Spark and Hive docker containers sharing a common MySQL metastore
  ☆26Updated 4 years ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆58Updated last year
• skhatri / trino-by-example
  Presto Trino with Apache Hive Postgres metastore
  ☆38Updated 4 months ago
• marclamberti / webinar-airflow-chart
  Materials of the Official Helm Chart Webinar
  ☆27Updated 3 years ago
• myamafuj / hadoop-hive-spark-docker
  Hadoop-Hive-Spark cluster + Jupyter on Docker
  ☆63Updated 2 weeks ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆43Updated 5 years ago
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆49Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆149Updated 7 months ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆118Updated last month
• tiagotxm / yt-spark-no-kubernetes
  ☆9Updated 3 weeks ago
• dgadiraju / nifi-workshop
  ☆26Updated 4 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆113Updated 2 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆94Updated 7 months ago
• tj--- / iceberg-demo
  A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino
  ☆19Updated 2 years ago
• bitsondatadev / trino-getting-started
  ☆256Updated 2 months ago
• jamesshocking / Spark-REST-API-UDF
  Example of how to leverage Apache Spark distributed capabilities to call REST-API using a UDF
  ☆50Updated 2 years ago