Alternatives and similar repositories for pyDag:

Users that are interested in pyDag are comparing it to the libraries listed below

• pybokeh / dagster-sklearn
  dagster scikit-learn pipeline example.
  ☆44Updated last year
• manuzhang / jupyterlab_spark
  Spark Application UI extension for JupyterLab
  ☆10Updated 3 years ago
• Wittline / pyspark-on-aws-emr
  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…
  ☆26Updated 2 years ago
• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆49Updated 4 years ago
• richardhe-fundamenta / dbt-container-for-bigquery
  A template DBT project for BigQuery on Google Cloud
  ☆12Updated 3 years ago
• godatadriven / airflow-training-skeleton
  Skeleton project for Apache Airflow training participants to work on.
  ☆16Updated 4 years ago
• debussy-labs / debussy_concert
  Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…
  ☆28Updated last year
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• 1997mahadi / dbt-dlt-ingestion-pipeline
  ☆17Updated 6 months ago
• hotgluexyz / recipes
  Simple samples for writing ETL transform scripts in Python
  ☆22Updated 3 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• josephmachado / change_data_capture
  Repo for CDC with debezium blog post
  ☆27Updated 5 months ago
• sizrailev / life-around-data-code
  Code snippets and tools published on the blog at lifearounddata.com
  ☆12Updated 5 years ago
• franloza / coches-net-dashboard
  Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market
  ☆56Updated 2 years ago
• karenbajador / pyspark_greatexpectations
  ☆11Updated 2 years ago
• zsvoboda / dbd
  dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
  ☆57Updated 3 years ago
• velascoluis / serverless-duckdb
  A serverless duckDB deployment at GCP
  ☆38Updated 2 years ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• sqlparser / python_data_lineage
  Data lineage tools in python
  ☆27Updated 3 months ago
• josephmachado / data_helper
  Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/
  ☆11Updated 8 months ago
• Snowflake-Labs / sfguide-recommender-pipeline
  Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker
  ☆31Updated 3 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 6 months ago
• dbt-labs / dbt-starter-project
  Cloned by the `dbt init` task
  ☆60Updated 9 months ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆63Updated last year
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆49Updated 6 months ago
• sashamitrovich / Streamlit-Snowflake
  ☆15Updated last year
• josephmachado / de_project
  Step by step instructions to create a production-ready data pipeline
  ☆37Updated last month