vishalsatam / Data-Pipelining

Related projects ⓘ

Alternatives and complementary repositories for Data-Pipelining

• AnalyticsInsightsNinja / Python_TidyData
  How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.
  ☆37Updated 5 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• ismaildawoodjee / GreatEx
  A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …
  ☆21Updated 2 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated last year
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆35Updated 6 years ago
• gwenshap / flask-and-kafka
  ☆10Updated 6 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 3 months ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 5 years ago
• GoogleCloudPlatform / bigquery-bokeh-dashboard
  ☆48Updated 2 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• PacktPublishing / Superset-Quick-Start-Guide
  Superset Quick Start Guide, published by Packt
  ☆55Updated 8 months ago
• sahilbhange / hive-sql-slowly-changing-dimension
  Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…
  ☆16Updated 5 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆68Updated 5 years ago
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated last year
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆54Updated 2 years ago
• hipic / biz_data_LA
  Business Data Analysis by HiPIC of CalStateLA
  ☆20Updated 6 years ago
• redapt / pyspark-s3-parquet-example
  This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…
  ☆19Updated 8 years ago
• postrational / airflow_tutorial
  ☆54Updated 6 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• mara / mara-example-project-1
  Runnable e-commerce mini data warehouse based on Python, PostgreSQL & Metabase, template for new projects
  ☆29Updated 3 years ago
• snowflakedb / snowflake-ingest-python
  A Python API for Asynchronously Loading Data into Snowflake DB -
  ☆60Updated this week
• groupon / luigi-warehouse
  A luigi powered analytics / warehouse stack
  ☆87Updated 7 years ago
• BasPH / airflow-rocket
  Airflow code accompanying blog post.
  ☆21Updated 5 years ago
• snowplow / snowplow-web-data-model
  SQL data model for working with Snowplow web data. Supports Redshift and Looker. Snowflake and BigQuery coming soon
  ☆61Updated 3 years ago
• FavioVazquez / ds-optimus
  How to do data science with Optimus, Spark and Python.
  ☆18Updated 5 years ago
• abhioncbr / docker-airflow
  Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…
  ☆32Updated 5 years ago
• NYUBigDataProject / SparkClean
  A Scalable Data Cleaning Library for PySpark.
  ☆26Updated 5 years ago
• mara / mara-etl-tools
  Utilities for creating ETL pipelines with mara
  ☆36Updated 2 years ago
• michaelchanwahyan / datalab
  ☆109Updated last year
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆94Updated 6 years ago