An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS application using Apache Airflow as an orchestration tool and various data warehouse technologies and finally using Apache Superset to connect to DWH for generating BI dashboards for weekly reports
☆27Dec 7, 2022Updated 3 years ago
Alternatives and similar repositories for Prescriber-ETL-data-pipeline
Users that are interested in Prescriber-ETL-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 3 years ago
- ☆11Jul 13, 2020Updated 6 years ago
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- Some exercises to learn Spark. Solved in Python.☆21Oct 15, 2024Updated 2 years ago
- ☆13Jul 4, 2020Updated 6 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Provision Ubuntu VMs with Vagrant and VMware on macOS ARM64☆11Oct 26, 2023Updated 3 years ago
- A package that can interpret GEMPACK-style TABLO models in R and solve them☆13Mar 19, 2024Updated 2 years ago
- ☆12May 1, 2022Updated 4 years ago
- ☆13Oct 3, 2022Updated 4 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆49Aug 23, 2019Updated 7 years ago
- This is an analytical project done using python to process and extract valuable insights from WhatsApp text file, deployed as a webapp us…☆19Dec 8, 2023Updated 2 years ago
- The Business Charts plugin integrates the powerful Apache ECharts library into Grafana, enabling you to create rich, interactive charts a…☆14Updated this week
- wppExplorer R package☆12Feb 28, 2025Updated last year
- Data Engineering Youtube Project☆12Jun 29, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆12Feb 6, 2023Updated 3 years ago
- Course Material - Data Science Program☆15Mar 31, 2026Updated 7 months ago
- People ask me about data science resources so I've curated some here: this is <<20% of the size of an 'awesome' list but has 80% of the v…☆11Jan 14, 2023Updated 3 years ago
- ☆11Jul 27, 2024Updated 2 years ago
- Mid price estimation in LOB using Markov model☆13May 11, 2022Updated 4 years ago
- In this project I used ML modeling and data analysis to predict ad clicks and significantly improve ad campaign performance, resulting in…☆12Nov 6, 2023Updated 3 years ago
- ☆12Jul 27, 2021Updated 5 years ago
- Project to experiment with a microservices architecture based on Apache Kafka☆22Jul 8, 2023Updated 3 years ago
- In this project first we fetch data of any stock(NSE) in realtime then we evaluate the stock price using basics visualizations then we…☆12Mar 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Machine Learning project for Machine Learning Internship offered by InternshipStudio.☆12Aug 8, 2021Updated 5 years ago
- ☆15Nov 10, 2022Updated 3 years ago
- ☆44Apr 30, 2026Updated 6 months ago
- Using the power of LLMs and Apache Superset to automate data visualization☆11Feb 5, 2025Updated last year
- Labs and demos for courses in the Data Engineer track of GCP Training (http://cloud.google.com/training).☆15Oct 28, 2019Updated 7 years ago
- An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)☆17Sep 20, 2023Updated 3 years ago
- In this tutorial, we have added step-by-step instructions to build your own AI chatbot with ChatGPT API. From setting up tools to install…☆10Apr 13, 2023Updated 3 years ago
- Explore the transformative power of data analytics in my portfolio, where Google Analytics and Snowflake converge to provide comprehensiv…☆11Apr 22, 2024Updated 2 years ago
- ARM 32-bit Raspberry Pi Hacking Int example in Kali Linux.☆13Nov 27, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Une application Android qui utilise l'API du site Tariki.dz☆10Aug 27, 2016Updated 10 years ago
- ☆21Jun 10, 2023Updated 3 years ago
- Sends public ip through e-mail. Command-line standalone.☆17Oct 16, 2016Updated 10 years ago
- Flink Example☆18Nov 19, 2023Updated 2 years ago
- ☆14Feb 18, 2022Updated 4 years ago
- Superwhisper voice integration extension for Pi☆12Jun 19, 2026Updated 4 months ago
- ☆14Mar 11, 2023Updated 3 years ago