dataquestio / analytics_pipeline
Code to build a simple analytics data pipeline with Python
☆102Updated 8 years ago
Alternatives and similar repositories for analytics_pipeline:
Users that are interested in analytics_pipeline are comparing it to the libraries listed below
- Course materials for my data pipeline video course with O'Reilly☆196Updated 7 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- Load data from redshift into a pandas DataFrame and vice versa.☆138Updated last year
- Here's how to get DataQuest's Data Engineering Track missions' content to work on your localhost. Using data from my Valenbisi ARIMA mode…☆15Updated 6 years ago
- 🐍💨 Airflow tutorial for PyCon 2019☆86Updated 2 years ago
- Code supporting Data Science articles at The Marketing Technologist, Floryn Tech Blog, and Pythom.nl☆71Updated 2 years ago
- ☆16Updated 7 years ago
- ☆46Updated 3 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆13Updated 5 years ago
- Repository used for Spark Trainings☆53Updated last year
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Using Luigi to create a Machine Learning Pipeline using the Rossman Sales data from Kaggle☆33Updated 8 years ago
- Code, slides, and documentation for the talks I have given.☆113Updated last year
- Airflow ETL for Meetup API☆46Updated 6 years ago
- A repo to track data engineering projects☆13Updated 2 years ago
- Business Data Analysis by HiPIC of CalStateLA☆20Updated 6 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆85Updated 4 years ago
- Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…☆32Updated 5 years ago
- An API to Analyze Cab GeoLocation Data and a Simulated App for finding an available cab in Real-Time☆63Updated 10 years ago
- Jupyter notebooks for pyspark tutorials given at University☆107Updated 4 months ago
- Udacity Data Engineering Nanodegree Projects☆11Updated 5 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 2 years ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Updated 3 years ago
- In the Data Science and Engineering program, engineering professionals combine the skills of software programmer, database manager, and s…☆27Updated 7 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 3 months ago
- ETL with Python - Taught at DWH course 2017 (TAU)☆102Updated 7 years ago
- Sharing interesting and noteworthy Data Engineering content☆67Updated 8 years ago
- Frank Kane's Taming Big Data with Apache Spark and Python, published by Packt☆122Updated 2 years ago