Alternatives and similar repositories for pyDag

Users that are interested in pyDag are comparing it to the libraries listed below

• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆47Updated 2 years ago
• Wittline / pyspark-on-aws-emr
  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…
  ☆27Updated 2 years ago
• pybokeh / dagster-sklearn
  dagster scikit-learn pipeline example.
  ☆44Updated 2 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆56Updated 9 months ago
• karenbajador / pyspark_greatexpectations
  ☆12Updated 3 years ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆52Updated this week
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆83Updated last year
• zsvoboda / dbd
  dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
  ☆57Updated 3 years ago
• josephmachado / data_helper
  Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/
  ☆11Updated 11 months ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆53Updated 4 years ago
• jw-ng / airflow-dynamic-dags
  ☆12Updated 3 years ago
• josephmachado / change_data_capture
  Repo for CDC with debezium blog post
  ☆28Updated 8 months ago
• Apress / pyspark-recipes
  Source code for 'PySpark Recipes' by Raju Kumar Mishra
  ☆25Updated 5 years ago
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆27Updated 2 years ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆136Updated 5 years ago
• Stefen-Taime / modern-data-pipeline
  reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
  ☆14Updated last year
• Snowflake-Labs / sfguide-recommender-pipeline
  Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker
  ☆31Updated 3 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• sizrailev / life-around-data-code
  Code snippets and tools published on the blog at lifearounddata.com
  ☆12Updated 5 years ago
• godatadriven / airflow-training-skeleton
  Skeleton project for Apache Airflow training participants to work on.
  ☆16Updated 4 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆68Updated last year
• PacktPublishing / Snowflake-Cookbook
  Snowflake Cookbook, published by Packt
  ☆79Updated 2 years ago
• manuzhang / jupyterlab_spark
  Spark Application UI extension for JupyterLab
  ☆10Updated 3 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆54Updated 2 years ago
• hotgluexyz / recipes
  Simple samples for writing ETL transform scripts in Python
  ☆22Updated 3 years ago
• astronomer / dynamic-dags-tutorial
  ☆28Updated last year