Data pipeline project
☆57Feb 11, 2025Updated last year
Alternatives and similar repositories for Data-pipeline-project
Users that are interested in Data-pipeline-project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project is built for personal purposes. Currently, I am enahancing it with an interactive bot that can recommend and help you improv…☆26Jul 27, 2026Updated 3 weeks ago
- Apache Spark using SQL☆14Aug 18, 2021Updated 5 years ago
- ☆18Aug 15, 2022Updated 4 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆50Dec 2, 2023Updated 2 years ago
- ☆26Jan 31, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)☆17Dec 18, 2018Updated 7 years ago
- Comprehensive study materials covering core data engineering concepts, tools, and practices.☆17Jan 20, 2026Updated 6 months ago
- This workshop is meant to give customers a hands-on experience with mentioned AWS services. Serverless Data Lake workshop helps customer…☆38Feb 9, 2021Updated 5 years ago
- Data cleaning, pre-processing, and Analytics on a Health care data using Spark and Python.☆48Jul 19, 2023Updated 3 years ago
- Multi-class hallucination detection for LLM safety using contextual NLP classification. Supports experiment tracking with MLflow and mode…☆15Mar 10, 2026Updated 5 months ago
- A full-stack AI-powered business intelligence tool for non-experts, featuring serverless backend processing and a secure Streamlit fronte…☆34Mar 26, 2026Updated 4 months ago
- ☆57Aug 14, 2024Updated 2 years ago
- Code for NeurIPS 2024 paper "A SARS-CoV-2 Interaction Dataset and VHH Sequence Corpus for Antibody Language Models"☆16Oct 17, 2024Updated last year
- Variable Selection Network with PyTorch☆12May 29, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- Đồ án tốt nghiệp | Data Lakehouse☆47Feb 9, 2026Updated 6 months ago
- Camera Tampering Detection using Python☆13Oct 17, 2018Updated 7 years ago
- My Portfolio of all the projects I did for both my Udacity Data Engineer and Data Streaming Nanodegrees☆21Jul 16, 2020Updated 6 years ago
- Dockerized analytics pipeline where Airflow moves mock-API data into Postgres, runs dbt transformations, and serves clean tables for Powe…☆82Oct 18, 2025Updated 10 months ago
- An example CI/CD pipeline using GitHub Actions for doing continuous deployment of AWS Glue jobs built on PySpark and Jupyter Notebooks.☆13Oct 15, 2020Updated 5 years ago
- ☆13Feb 18, 2021Updated 5 years ago
- ☆13Apr 14, 2023Updated 3 years ago
- ☆30May 16, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Create an advanced data engineering pipeline that processes and analyzes sales data from an e-commerce website using Apache Airflow for w…☆12Aug 28, 2023Updated 2 years ago
- ☆14Sep 9, 2022Updated 3 years ago
- Data set and queries that I use in my Hive and Impala presentations. Slides are usually posted at slideshare.net/markgrover☆20May 19, 2014Updated 12 years ago
- ☆13Feb 18, 2022Updated 4 years ago
- Public GitHub repo for SciPy 2022 tutorial (Introduction to Numerical Computing With NumPy)☆13Aug 24, 2022Updated 3 years ago
- Run Apache Airflow with CeleryExecutor using Docker Compose. Includes scalable workers, Redis broker, PostgreSQL metadata DB, Flower UI, …☆15Jul 12, 2026Updated last month
- A Genetic Algorithms framework for Hadoop MapReduce.☆10May 30, 2018Updated 8 years ago
- ☆16Apr 26, 2020Updated 6 years ago
- Code for the paper "Active learning for medical image segmentation with stochastic batches", published at Medical Image Analysis (2023).☆10Nov 14, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An online shopping cart using Clean Architecture and based on Mini-Web-Server☆12Jan 24, 2024Updated 2 years ago
- Social Media Analysis, scalable solution, flexible deployment that analyses social media contents☆10Jul 20, 2023Updated 3 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆77Dec 12, 2023Updated 2 years ago
- ☆14Mar 11, 2023Updated 3 years ago
- ☆18Nov 16, 2018Updated 7 years ago
- A take home exercise for ingesting data from the NVD feeds and OSV vulnerabilities database.☆20Jul 2, 2024Updated 2 years ago
- ☆12Feb 9, 2019Updated 7 years ago