Data pipeline project
☆57Feb 11, 2025Updated last year
Alternatives and similar repositories for Data-pipeline-project
Users that are interested in Data-pipeline-project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark using SQL☆14Aug 18, 2021Updated 4 years ago
- Apache Spark Guide☆38Feb 1, 2022Updated 4 years ago
- Hands-On DevOps with Ansible [Video], Published By Packt☆14Jan 15, 2021Updated 5 years ago
- This workshop is meant to give customers a hands-on experience with mentioned AWS services. Serverless Data Lake workshop helps customer…☆38Feb 9, 2021Updated 5 years ago
- ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)☆17Dec 18, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- ☆18Aug 15, 2022Updated 3 years ago
- An example CI/CD pipeline using GitHub Actions for doing continuous deployment of AWS Glue jobs built on PySpark and Jupyter Notebooks.☆13Oct 15, 2020Updated 5 years ago
- Jordan Cheah's Data Science & Data Engineering Portfolio☆27May 23, 2016Updated 10 years ago
- ☆13Apr 14, 2023Updated 3 years ago
- Build and run Spark Structured Streaming pipelines in Hadoop - project using PySpark.☆13Jun 6, 2019Updated 7 years ago
- ☆14Sep 9, 2022Updated 3 years ago
- Data set and queries that I use in my Hive and Impala presentations. Slides are usually posted at slideshare.net/markgrover☆20May 19, 2014Updated 12 years ago
- Computer Vision☆13Apr 22, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Camera Tampering Detection using Python☆13Oct 17, 2018Updated 7 years ago
- A Genetic Algorithms framework for Hadoop MapReduce.☆10May 30, 2018Updated 8 years ago
- Airflow 2.0 configuration with Celery Executor based on Docker containers with Postgres and Redis broker plus Flower and Webserver UI☆15May 13, 2021Updated 5 years ago
- My Portfolio of all the projects I did for both my Udacity Data Engineer and Data Streaming Nanodegrees☆21Jul 16, 2020Updated 5 years ago
- ☆16Apr 26, 2020Updated 6 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆77Dec 12, 2023Updated 2 years ago
- Resilient Automation Functions and Scripts☆15Jan 5, 2022Updated 4 years ago
- Run dynamic SQL in SQL. This package allows queries with an unknown number of select-list items and can solve challenging problems like d…☆12Oct 5, 2024Updated last year
- A take home exercise for ingesting data from the NVD feeds and OSV vulnerabilities database.☆20Jul 2, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆18Nov 16, 2018Updated 7 years ago
- ☆12Feb 9, 2019Updated 7 years ago
- Building pipeline to process the real-time data using Spark and Mongodb.☆12Oct 30, 2019Updated 6 years ago
- ☆17Sep 27, 2020Updated 5 years ago
- Public GitHub repo for SciPy 2022 tutorial (Introduction to Numerical Computing With NumPy)☆13Aug 24, 2022Updated 3 years ago
- A Persian Word2Vec Model trained by Wikipedia articles☆10Jan 5, 2018Updated 8 years ago
- Command-line tool to generate Python applications and libraries☆11May 13, 2025Updated last year
- A code sample that allows you to send a payload from the Twitter API to Google Sheets.☆17Mar 23, 2021Updated 5 years ago
- Labs and data files for a full-day Spark workshop☆25May 24, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Helm charts for kafbat projects☆23Apr 20, 2026Updated 2 months ago
- Real-time streaming data pipeline for Twitter Tweets☆10Jan 31, 2022Updated 4 years ago
- ☆11Oct 19, 2018Updated 7 years ago
- All my projects on Big Data are provided☆27Dec 5, 2016Updated 9 years ago
- Exploratory Data Analysis ; Deep Learning 3;☆12Aug 31, 2018Updated 7 years ago
- Stream processing engine☆13Apr 7, 2021Updated 5 years ago
- ☆10Dec 10, 2018Updated 7 years ago