Alternatives and similar repositories for airflow-pipeline:

Users that are interested in airflow-pipeline are comparing it to the libraries listed below

• sungchun12 / serverless-data-pipeline-gcp
  Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and p…
  ☆26Updated 5 years ago
• airflow-plugins / mongo_plugin
  ☆23Updated 5 years ago
• data-describe / awesome-data-science-models
  A few end to end examples that use data-describe
  ☆16Updated last year
• khuyentran1401 / prefect-docker
  Demo on how to use Prefect with Docker
  ☆25Updated 2 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• orchest / orchest-examples
  Awesome Orchest projects, both official and submitted by the community.
  ☆25Updated last year
• khuyentran1401 / prefect2-mlops-demo
  Demo on how to use Prefect 2 in an ML project
  ☆41Updated 2 years ago
• sashamitrovich / Streamlit-Snowflake
  ☆15Updated last year
• kennethleungty / Fortune-Global-500-Bar-Chart-Race
  Using Python and Flourish to visualize rank and revenue trends of the world’s largest companies
  ☆13Updated 10 months ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆49Updated 4 years ago
• jacobceles / intro-to-colab-pyspark-emr
  A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …
  ☆20Updated 3 years ago
• flavienbwk / Pandemic-Knowledge
  A fully-featured multi-source data pipeline for continuously extracting knowledge from COVID-19 data.
  ☆21Updated 3 years ago
• PrefectHQ / prefect-openai
  Prefect integrations for working with OpenAI.
  ☆36Updated 9 months ago
• feroult / serverless-superset
  Serverless Superset on Google Cloud
  ☆22Updated 3 years ago
• TristanBilot / bqfetch
  A lightweight tool to fetch tables from BigQuery as pandas DataFrame very fast using BigQuery Storage API combined with multiprocessing
  ☆27Updated last year
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 6 months ago
• chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCP
  This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. Ther…
  ☆20Updated last week
• GoogleCloudPlatform / cloud-composer-mssql-dataflow-bigquery
  This repository contains an example of how to leverage Cloud Composer and Cloud Dataflow to move data from a Microsoft SQL Server to BigQ…
  ☆18Updated 9 months ago
• ismaildawoodjee / GreatEx
  A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …
  ☆21Updated 2 years ago
• elasticlabs / airflow-jupyter-docker-compose
  Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter note…
  ☆35Updated 2 years ago
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆75Updated last year
• jbarrasa / datasets
  ☆13Updated last month
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆55Updated 3 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• danhphan / trusted-data-pipeline
  Building 3D Trusted Data Pipelines With Dagster, Dbt, and Duckdb
  ☆20Updated last year
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆28Updated 3 years ago
• iterative / cml_dvc_case
  ☆17Updated last year
• CSCfi / airflow-openshift
  Run Apache Airflow on OpenShift
  ☆14Updated 3 years ago
• alvarobartt / tensorflow-serving-streamlit
  TensorFlow Serving + Streamlit!
  ☆22Updated 3 years ago