vishalsatam / Data-Pipelining

Related projects ⓘ

Alternatives and complementary repositories for Data-Pipelining

• airflow-plugins / mongo_plugin
  ☆23Updated 5 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• abhioncbr / docker-airflow
  Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…
  ☆32Updated 5 years ago
• postrational / airflow_tutorial
  ☆54Updated 6 years ago
• PacktPublishing / Superset-Quick-Start-Guide
  Superset Quick Start Guide, published by Packt
  ☆55Updated 8 months ago
• snowplow / snowplow-web-data-model
  SQL data model for working with Snowplow web data. Supports Redshift and Looker. Snowflake and BigQuery coming soon
  ☆61Updated 3 years ago
• mara / mara-example-project-1
  Runnable e-commerce mini data warehouse based on Python, PostgreSQL & Metabase, template for new projects
  ☆29Updated 3 years ago
• mara / mara-db
  Lightweight configuration and access to multiple databases in a single project
  ☆38Updated 10 months ago
• kadnan / airflow-scraping
  Using Apache Airflow to schedule web scrapers
  ☆42Updated 6 years ago
• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• danielblazevski / airflow-pyspark-reddit
  Example of using Airflow to schedule downloading data form S3 and launching spark jobs
  ☆15Updated 8 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• hipic / biz_data_LA
  Business Data Analysis by HiPIC of CalStateLA
  ☆20Updated 6 years ago
• Sean-Bradley / Stream-Data-From-Flask-To-Postgres
  A tutorial on streaming data from a Flask REST API and streaming the response into PostgreSQL
  ☆39Updated 5 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆94Updated 6 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆68Updated 5 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 5 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆54Updated 2 years ago
• stitchdata / python-stitch-client
  A python client library for the Stitch Import API
  ☆42Updated 10 months ago
• redapt / pyspark-s3-parquet-example
  This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…
  ☆19Updated 8 years ago
• GoogleCloudPlatform / bigquery-bokeh-dashboard
  ☆48Updated 2 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 2 months ago
• punkdata / python-circleci-docker
  CI/CD Docker Pipeline Demo
  ☆19Updated 2 years ago
• mara / mara-etl-tools
  Utilities for creating ETL pipelines with mara
  ☆36Updated 2 years ago
• michaelchanwahyan / datalab
  ☆109Updated last year
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 3 years ago
• bwiley1 / pandleau
  A quick and easy way to convert a Pandas DataFrame to a Tableau .hyper or .tde extract.
  ☆61Updated 4 years ago