markwsutton / ETL-using-Python-SQL
ETL using Python in Jupyter Notebook, loading CSV, cleaning data, and saving to SQL Database.
☆12Updated 4 years ago
Alternatives and similar repositories for ETL-using-Python-SQL:
Users that are interested in ETL-using-Python-SQL are comparing it to the libraries listed below
- For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retri…☆27Updated 4 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆8Updated 3 years ago
- This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.☆13Updated 2 years ago
- Simple ETL pipeline using Python☆25Updated last year
- ☆28Updated last year
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆24Updated last year
- All Data Engineering notebooks from Datacamp course☆115Updated 5 years ago
- ☆19Updated 2 weeks ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆21Updated last year
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆43Updated 5 years ago
- Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3☆29Updated 4 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆10Updated last year
- ☆19Updated last year
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆16Updated 5 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆14Updated 3 years ago
- data-warehouse-snowflake-for-data-engineering☆14Updated last year
- SQL for Data Analysis using PostgresSQL - analyzing Parch&Posey fictional company☆18Updated 4 years ago
- Lecture notes, lab notes, and links to helpful resources to pass Google Certification Exam for Professional Data Engineer.☆17Updated 2 years ago
- ☆87Updated 2 years ago
- Cracking Data Engineering Interview Guide, published by Packt☆40Updated last year
- ☆12Updated 3 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29Updated last year
- Case Study's from Danny Ma's Serious SQL Course☆19Updated 2 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆21Updated 2 years ago
- This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science t…☆52Updated last month
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆80Updated 5 years ago
- Ravi Azure ADB ADF Repository☆66Updated 3 weeks ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- Course Material Data Engineering on AWS Course☆28Updated 5 months ago
- My solutions to exercises from various SQL learning courses and platforms☆11Updated 3 years ago