vishalsatam / Data-Pipelining
☆26Updated 4 years ago
Alternatives and similar repositories for Data-Pipelining:
Users that are interested in Data-Pipelining are comparing it to the libraries listed below
- SQL data model for working with Snowplow web data. Supports Redshift and Looker. Snowflake and BigQuery coming soon☆60Updated 4 years ago
- Big Data Demystified meetup and blog examples☆31Updated 5 months ago
- Lightweight configuration and access to multiple databases in a single project☆38Updated last year
- Code to build a simple analytics data pipeline with Python☆102Updated 7 years ago
- CSV loader for Amazon Redshift.☆12Updated 5 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Udacity Data Pipeline Exercises☆15Updated 4 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆106Updated this week
- A quick and easy way to convert a Pandas DataFrame to a Tableau .hyper or .tde extract.☆61Updated 5 years ago
- Data lake, data warehouse on GCP☆55Updated 3 years ago
- SQL-based transforms compatible with Rasgo and PyRasgo☆24Updated 9 months ago
- ☆28Updated 4 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated last year
- Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.☆16Updated 4 years ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆36Updated 6 months ago
- Superset Quick Start Guide, published by Packt☆56Updated 10 months ago
- Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…☆32Updated 5 years ago
- Airflow workflow management platform chef cookbook.☆69Updated 5 years ago
- Example of using Airflow to schedule downloading data form S3 and launching spark jobs☆15Updated 8 years ago
- Runnable e-commerce mini data warehouse based on Python, PostgreSQL & Metabase, template for new projects☆29Updated 3 years ago
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆121Updated 7 months ago
- ☆54Updated 6 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 2 years ago
- A python client library for the Stitch Import API☆42Updated last year
- Setup Apache Airflow on Kubernetes☆9Updated 6 years ago
- Business Data Analysis by HiPIC of CalStateLA☆20Updated 6 years ago
- ☆48Updated 3 years ago
- How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.☆37Updated 5 years ago
- ☆23Updated 5 years ago