For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retrieve data from different sources, clean and transform it into a useful format and finally load the data into an SQL database where the data is ready for further analysis. The result is an established automated p…
☆26Feb 9, 2021Updated 5 years ago
Alternatives and similar repositories for Movies-ETL
Users that are interested in Movies-ETL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Classwork projects and home works done through Udacity data engineering nano degree☆10Jun 6, 2021Updated 5 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆13May 25, 2023Updated 3 years ago
- Apartments Data Pipeline using Airflow and Spark.☆24Mar 28, 2022Updated 4 years ago
- This is a capstone project that entails building an end-to-end ETL (Extract-Transform-Load) Data pipeline which extracts UK accident and …☆18Jun 6, 2020Updated 6 years ago
- My documents for self-learning fundamental of Data engineering skills☆14Aug 5, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Notes on time series forecasting☆18Mar 8, 2020Updated 6 years ago
- A simple tool for monitoring the progress of OpenFOAM simulations☆13Nov 9, 2018Updated 7 years ago
- Some functions to plot OpenFOAM data with Matplotlib☆11Apr 15, 2021Updated 5 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- The curatedOvarianData package provides data for gene expression analysis in patients with ovarian cancer☆13May 14, 2026Updated 3 months ago
- ☆16Feb 20, 2026Updated 5 months ago
- A simple bot to answer questions on my personal website. (In development)☆43May 28, 2021Updated 5 years ago
- 3NF-normalize Yelp data on S3 with Spark and load it into Redshift - automate the whole thing with Apache Airflow☆13Aug 17, 2019Updated 7 years ago
- I created a blog web page using simple HTML,CSS and js .☆14Jan 24, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This project provides valuable customer sentiment insights for Zomato by tracking and analyzing tweets related to their brand and service…☆15Aug 27, 2023Updated 2 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆51Aug 23, 2019Updated 6 years ago
- ☆21Jan 13, 2024Updated 2 years ago
- Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator☆13May 23, 2021Updated 5 years ago
- ☆11Apr 9, 2022Updated 4 years ago
- small african spatial datasets for learning & teaching mapping in R☆17Nov 9, 2021Updated 4 years ago
- Basic example code for Langchain in Python.☆10Oct 19, 2023Updated 2 years ago
- Programs of learning (GeeksForGeeks)☆10Jul 15, 2021Updated 5 years ago
- BitDust user App written in Python using Kivy framework☆15Aug 23, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Some python scripts for beginners, written for the book Automating The Internet with Python☆13Oct 1, 2018Updated 7 years ago
- Predicting the price of Bitcoin, intro to LSTM☆12Dec 26, 2022Updated 3 years ago
- ☆21Nov 9, 2022Updated 3 years ago
- A Tutorial Introduction to R☆16Sep 6, 2023Updated 2 years ago
- ☆11Jan 9, 2022Updated 4 years ago
- Port of cgnsToFoam from TurbMachinery SIG to OpenFOAM 5.x and newer☆17Sep 19, 2023Updated 2 years ago
- Misc simulation cases☆14Dec 18, 2017Updated 8 years ago
- ☆16Sep 14, 2024Updated last year
- The Jembi MPI, also known as JeMPI, is a standards-based client registry (CR) or master patient index (MPI). JeMPI facilitates the exchan…☆23Apr 16, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16May 24, 2023Updated 3 years ago
- Subdomain Scanner - the most exhaustive tool for sub-domain recognition and mapping to related IPs and ASNs☆18Jul 4, 2025Updated last year
- Generate Duolingo-style quiz courses from PDFs with spaced repetition, adaptive difficulty, and tutor chat.☆16Apr 6, 2026Updated 4 months ago
- This guide will demonstrate how to deploy a minimal Apache Kafka cluster on Docker and set up producers and consumers using Python. We wi…☆18Nov 15, 2020Updated 5 years ago
- ☆16Apr 18, 2025Updated last year
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆104Aug 11, 2019Updated 7 years ago
- Get exam-ready with scenario-based questions and detailed answers generated by AI for the AWS Solutions Architect certification.☆19Apr 2, 2023Updated 3 years ago