For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retrieve data from different sources, clean and transform it into a useful format and finally load the data into an SQL database where the data is ready for further analysis. The result is an established automated p…
☆26Feb 9, 2021Updated 5 years ago
Alternatives and similar repositories for Movies-ETL
Users that are interested in Movies-ETL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ETL using Python in Jupyter Notebook, loading CSV, cleaning data, and saving to SQL Database.☆14Nov 17, 2020Updated 5 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆14May 25, 2023Updated 3 years ago
- Apartments Data Pipeline using Airflow and Spark.☆24Mar 28, 2022Updated 4 years ago
- Data Science Learning Notes☆11Oct 18, 2023Updated 2 years ago
- This is a capstone project that entails building an end-to-end ETL (Extract-Transform-Load) Data pipeline which extracts UK accident and …☆18Jun 6, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Describes the concepts of lambda architecture and the actual deployment process with an example of building a serverless business intelli…☆15Jul 28, 2026Updated last month
- Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift☆14Jun 12, 2019Updated 7 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Oct 15, 2022Updated 3 years ago
- This is a simple ETL project with Python :)☆42Oct 31, 2022Updated 3 years ago
- Build a predictive model to automate the process of targeting the right applicants☆30May 13, 2021Updated 5 years ago
- A simple tool for monitoring the progress of OpenFOAM simulations☆13Nov 9, 2018Updated 7 years ago
- Sample example projects referenced for opensource.com articles☆11Dec 19, 2023Updated 2 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- Matlab toolbox for generating block structured hex meshes in the polyMesh file format of OpenFOAM.☆15Jan 2, 2013Updated 13 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆16Feb 20, 2026Updated 6 months ago
- 3NF-normalize Yelp data on S3 with Spark and load it into Redshift - automate the whole thing with Apache Airflow☆13Aug 17, 2019Updated 7 years ago
- This project provides valuable customer sentiment insights for Zomato by tracking and analyzing tweets related to their brand and service…☆15Aug 27, 2023Updated 3 years ago
- DVD Rental Co Marketing Analytics Case Study - Serious SQL ✨☆11Sep 25, 2021Updated 4 years ago
- A Python package for working with OpenFOAM.☆16Oct 2, 2024Updated last year
- BitDust user App written in Python using Kivy framework☆15Aug 23, 2025Updated last year
- India based Hardware company Sales Insights - A Data Analysis Project performed on Tableau & SQL☆62Nov 16, 2022Updated 3 years ago
- ☆11Jan 9, 2022Updated 4 years ago
- ☆22May 1, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Port of cgnsToFoam from TurbMachinery SIG to OpenFOAM 5.x and newer☆17Sep 19, 2023Updated 2 years ago
- Misc simulation cases☆14Dec 18, 2017Updated 8 years ago
- ☆16Sep 14, 2024Updated last year
- ☆16May 24, 2023Updated 3 years ago
- This guide will demonstrate how to deploy a minimal Apache Kafka cluster on Docker and set up producers and consumers using Python. We wi…☆18Nov 15, 2020Updated 5 years ago
- ☆16Apr 18, 2025Updated last year
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆104Aug 11, 2019Updated 7 years ago
- Write your dissertation in Rmarkdown☆14May 29, 2021Updated 5 years ago
- Add a passive scalar transport equation to the pimpleFoam solver in OpenFOAM☆17Jul 2, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- It is a basic Rule Base ChatBot purely made in Python(Flask) and run on server hosted on PythonAnywhere and works with the help of Twilio…☆18Aug 13, 2024Updated 2 years ago
- A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc☆17Mar 18, 2022Updated 4 years ago
- A structured streaming was applied to the robot data from ROS-Gazebo simulation environment using Apache Spark. Data is collected in Kafk…☆19Feb 6, 2022Updated 4 years ago
- Data science virtual internship program by British Airways through Forage!☆43Jan 10, 2023Updated 3 years ago
- Data science and machine learning are fast-paced emerging technologies across all industries including oil and gas. The oil and gas indus…☆50Jan 28, 2023Updated 3 years ago
- This is a template you can use for your next data engineering portfolio project.☆193Sep 10, 2021Updated 4 years ago
- This repo contains commands that data engineers use in day to day work.☆64Feb 4, 2023Updated 3 years ago