ultranet1 / APACHE_AIRFLOW_DATA_PIPELINESLinks
Project Description: A music streaming company wants to introduce more automation and monitoring to their data warehouse ETL pipelines and they have come to the conclusion that the best tool to achieve this is Apache Airflow. As their Data Engineer, I was tasked to create a reusable production-grade data pipeline that incorporates data quality c…
☆18Updated 4 years ago
Alternatives and similar repositories for APACHE_AIRFLOW_DATA_PIPELINES
Users that are interested in APACHE_AIRFLOW_DATA_PIPELINES are comparing it to the libraries listed below
Sorting:
- Projects completed under LinuxWorld Informatics Ltd. - MLOps Training.☆12Updated 5 years ago
- Streamlit example showing Scikit Learn & Pyspark ML over Healthcare data ! Its simple !!☆32Updated 4 years ago
- Simple demo for Databricks!☆14Updated 2 years ago
- Insurance fraud claims analysis project☆54Updated last year
- Learn Apache Airflow in easy way☆31Updated 4 years ago
- Supply chain planning using max flow formulated as mixed integer linear programming☆10Updated 5 years ago
- The project demonstrates an example of how to use a supervised learning task using GPT-3.5 with JSON export, evaluating reviews in differ…☆16Updated last year
- Airflow Tutorials☆25Updated 4 years ago
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆16Updated 6 years ago
- Demonstrating the efficiency of pmdarima’s auto_arima() function compared to implementing a traditional ARIMA model.☆10Updated 4 years ago
- Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple …☆30Updated 5 years ago
- Amazon Redshift Cookbook, Published by Packt☆15Updated 2 years ago
- Create Interactive Dashboards with Streamlit and Python Coursera☆10Updated 5 years ago
- MLFlow End to End Workshop at Chandigarh University☆11Updated 2 years ago
- ☆18Updated 7 years ago
- The code examples from my online content☆18Updated last year
- Automate PowerPoint Slides Creation with Python☆36Updated 8 months ago
- code, labs and lectures for the course☆48Updated 2 years ago
- Multiprocessing in python☆10Updated 4 years ago
- Challenge Data Engineer☆25Updated 3 years ago
- Data pipeline project using Data Factory, Databricks and Cosmosdb Graph, deployed using Azure DevOps, secured using firewalls and Azure A…☆11Updated 2 years ago
- Microsoft Certified: Azure Data Scientist Associate Certification Guide, published by Packt☆59Updated last month
- SQL Tutorials using Jupyter Notebook☆17Updated 2 years ago
- ☆11Updated 4 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆102Updated last month
- Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups☆18Updated 7 years ago
- A chatbot made using the Chatterbot library in Python and locally hosted using Streamlit. Dataset used were collected during ConvAI2 comp…☆15Updated 4 years ago
- Use Natural Language Processing (NLP) to create a summary for long reports.☆12Updated 4 years ago
- Techniques for Scraping the Web in Python☆26Updated 7 years ago
- Content related to Mastering Postgresql along with videos.☆18Updated 4 years ago