astronomer / airflow-guide-passing-data-between-tasksLinks
☆10Updated 4 years ago
Alternatives and similar repositories for airflow-guide-passing-data-between-tasks
Users that are interested in airflow-guide-passing-data-between-tasks are comparing it to the libraries listed below
Sorting:
- Just starting your DE journey or along the way already?. I will be sharing a short list of DATA-ENGINEERING-CENTRED books that covers the…☆34Updated 2 years ago
- Build a semantic search application with deep learning models.☆14Updated 6 months ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆31Updated last year
- Create a local dashboard to visualize and filter your GitHub feed☆29Updated 2 years ago
- This repo is meant to make it really easy to analyze the interplays between health and social media use.☆44Updated 2 years ago
- Using a feature store to connect the DataOps and MLOps workflows to enable collaborative teams to develop efficiently.☆56Updated 2 years ago
- Multi-docker container data science / engineering playground (w/ Kafka, Airflow, MLFlow, Tensorflow-Keras / SKLearn) for simulating a mic…☆11Updated 2 years ago
- Build an scikit-learn model to predict churn using customer telco data.☆16Updated 6 months ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆69Updated last year
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆22Updated 3 years ago
- A repository that showcases how you can use ZenML with Git☆69Updated 3 weeks ago
- ☆12Updated 3 years ago
- ☆40Updated 11 months ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 10 months ago
- Finance 🏦 Data Builder 🛠️ @ postgres 🐘☆21Updated 4 years ago
- pyspark dataframe made easy☆16Updated 3 years ago
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- ☆12Updated 3 years ago
- This app allows users to easily query a PDF document using OpenAI's GPT-3 language model in Google Colab, utilizing Google Drive for stor…☆37Updated last year
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆27Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.☆16Updated 4 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Recohut - Learn data engineering, data science☆97Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- Machine Learning Ops Project☆29Updated last year
- ☆11Updated last year
- A set of jupyter notebooks☆23Updated 5 months ago
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆53Updated last year
- Deploy A/B testing infrastructure in a containerized microservice architecture for Machine Learning applications.☆40Updated 4 months ago