Spark data pipeline that processes movie ratings data.
☆31Nov 1, 2026Updated 2 weeks ago
Alternatives and similar repositories for spark-movies-etl
Users that are interested in spark-movies-etl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Nov 1, 2026Updated 2 weeks ago
- Create a data pipeline on AWS to execute batch processing in a Spark cluster provisioned by Amazon EMR. ETL using managed airflow: extrac…☆10Jul 12, 2021Updated 5 years ago
- ☆25Dec 18, 2020Updated 5 years ago
- Blog post on ETL pipelines with Airflow☆23Aug 31, 2025Updated last year
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Aug 11, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…☆29Aug 8, 2020Updated 6 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 3 years ago
- End-to-end ELT data engineering project☆23Dec 24, 2022Updated 3 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Dec 3, 2020Updated 5 years ago
- RevoData's custom Declarative Automation Bundle templates (Revo-DABs)☆13Oct 26, 2026Updated 3 weeks ago
- End-to-end testing and local dev tool for PySpark ML data pipelines using sampled data☆15Nov 10, 2026Updated last week
- I upload all the content which I explain in YouTube☆14Mar 15, 2026Updated 8 months ago
- Python tool for profiling-based anomaly monitoring on ETL data pipelines leveraging ML and Apache Spark.☆16Mar 5, 2024Updated 2 years ago
- Automation of Databricks workflows☆13Nov 9, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Oct 31, 2026Updated 2 weeks ago
- Entity Resolution☆16Mar 5, 2024Updated 2 years ago
- Shows how to create a PySpark application which you can debug locally and execute from Azure Data Factory☆14Nov 30, 2018Updated 7 years ago
- A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apa…☆30Jun 7, 2023Updated 3 years ago
- ☆14Feb 23, 2025Updated last year
- Surface crack images classification using PyTorch Lightning☆11Jun 17, 2020Updated 6 years ago
- Example of how to import python native modules into a Databricks Notebook☆15Jul 18, 2019Updated 7 years ago
- ☆18Aug 6, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A repo to track data engineering projects☆14Nov 11, 2022Updated 4 years ago
- Code for youtube channel☆10Apr 15, 2022Updated 4 years ago
- a list of links to help you make various important architectural decisions☆11Jul 13, 2016Updated 10 years ago
- ☆11May 16, 2022Updated 4 years ago
- This is a simple ETL using Airflow. First, we fetch data from API (extract). Then, we drop unused columns, convert to CSV, and validate (…☆24Oct 12, 2019Updated 7 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆50Dec 2, 2023Updated 2 years ago
- ☆27Mar 7, 2022Updated 4 years ago
- ☆10Jun 11, 2026Updated 5 months ago
- ☆11Apr 25, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Powershell Scripts for Power BI☆13Sep 20, 2023Updated 3 years ago
- Resources backing the Feast fraud tutorial on GCP☆17May 31, 2022Updated 4 years ago
- Apache NiFi deployment on OpenShift☆13Jul 18, 2023Updated 3 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated last year
- Presentations☆12Updated this week
- Set of scripts to terminate various GCP resources to save cash and cats 🐈☆14Jan 25, 2021Updated 5 years ago
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆25Nov 19, 2024Updated last year
Are these results useful?