Alternatives and similar repositories for DockerSpark245

Users that are interested in DockerSpark245 are comparing it to the libraries listed below

• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆262Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 3 years ago
• cluster-apps-on-docker / spark-standalone-cluster-on-docker
  Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.
  ☆500Updated 3 weeks ago
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆38Updated 4 years ago
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆24Updated 3 years ago
• yTek01 / docker-spark-airflow
  ☆40Updated 2 years ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆64Updated 2 years ago
• ryanchynoweth44 / DatabricksContent
  Examples surrounding Databricks.
  ☆60Updated last year
• mrn-aglic / pyspark-playground
  ☆92Updated 9 months ago
• sdesilva26 / docker-spark
  Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
  ☆134Updated 3 years ago
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆143Updated 2 years ago
• mrn-aglic / spark-standalone-cluster
  This repo contains a spark standalone cluster on docker for anyone who wants to play with PySpark by submitting their applications.
  ☆37Updated 2 years ago
• Marcel-Jan / docker-hadoop-spark
  Multi-container environment with Hadoop, Spark and Hive
  ☆226Updated 6 months ago
• mrn-aglic / apache-iceberg-data-exploration
  ☆20Updated last year
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆34Updated 5 years ago
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆105Updated 2 years ago
• martinkarlssonio / big-data-solution
  ☆47Updated 2 years ago
• mshtelma / databricks_ml_demo
  ☆40Updated 3 years ago
• derar-alhussein / Databricks-Certified-Data-Engineer-Professional
  The resources of the preparation course for Databricks Data Engineer Professional certification exam
  ☆153Updated last month
• alonsomedo / os-data-stack
  Building a Data Pipeline with an Open Source Stack
  ☆55Updated 5 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆233Updated last year
• alexott / databricks-nutter-repos-demo
  Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline
  ☆153Updated last year
• hnawaz007 / pythondataanalysis
  Python data repo, jupyter notebook, python scripts and data.
  ☆540Updated 11 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆44Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated 2 years ago
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆37Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆275Updated 8 months ago
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆143Updated 10 months ago
• szymonzaczek / databricks-ci-cd
  Databricks CI/CD using Azure DevOps
  ☆21Updated 3 years ago
• dbsys21 / databricks-lakehouse
  This repo contains live examples to build Databricks' Lakehouse and recommended best practices from the field.
  ☆22Updated last year