astronomer / airflow-guide-passing-data-between-tasksLinks
☆10Updated 4 years ago
Alternatives and similar repositories for airflow-guide-passing-data-between-tasks
Users that are interested in airflow-guide-passing-data-between-tasks are comparing it to the libraries listed below
Sorting:
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆28Updated 3 years ago
- Build an scikit-learn model to predict churn using customer telco data.☆17Updated 7 months ago
- ☆12Updated 3 years ago
- Deploy A/B testing infrastructure in a containerized microservice architecture for Machine Learning applications.☆40Updated 6 months ago
- Multi-docker container data science / engineering playground (w/ Kafka, Airflow, MLFlow, Tensorflow-Keras / SKLearn) for simulating a mic…☆11Updated 2 years ago
- ☆18Updated last year
- A tool for managers/teachers to gauge student activity/engagement/mood based on Slack data☆15Updated 3 years ago
- Here I will be exploring various tools and methods that are used in data engineering process with Python.☆22Updated 4 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 5 years ago
- ☆18Updated 3 years ago
- Instant search for and access to many datasets in Pyspark.☆34Updated 2 years ago
- Predict the number of deaths due to covid19 in the next two weeks☆11Updated 2 years ago
- Creating a Gradio user interface to predict the sentiment of a tweet☆12Updated 3 years ago
- A Snowflake GPT Demo using SqlAlchemy☆23Updated 2 years ago
- Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟☆53Updated 3 years ago
- A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …☆20Updated 3 years ago
- This repository contains NiFi processors for interacting with Snowflake Cloud Data Platform.☆12Updated 7 months ago
- my personal working directory of milvus projects☆17Updated last year
- CDF Tech Bootcamp☆9Updated 5 years ago
- Making Machine Learning Simple and Scalable with Python, Jupyter Notebook, TensorFlow, Keras, Apache Kafka and KSQL☆96Updated 6 years ago
- Machine Learning pipeline MVP on Docker and Apache Airflow☆15Updated 3 years ago
- Using the Parquet file format with Python☆15Updated last year
- Projects developed by Domino's R&D team☆78Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- A pipeline to detect data drift and retrain the model when there is drift☆23Updated last year
- This repo is meant to make it really easy to analyze the interplays between health and social media use.☆44Updated 3 years ago
- Test LightGBM's Dask integration on different cluster types☆12Updated last week
- Streamlit example showing Scikit Learn & Pyspark ML over Healthcare data ! Its simple !!☆32Updated 4 years ago
- Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.☆16Updated 4 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆14Updated 2 years ago