astronomer / airflow-guide-passing-data-between-tasks

Related projects ⓘ

Alternatives and complementary repositories for airflow-guide-passing-data-between-tasks

• cloudera / CML_AMP_Image_Analysis
  Build a semantic search application with deep learning models.
  ☆13Updated last year
• VinayChaudhari1996 / pyspark-dataframe-made-easy
  pyspark dataframe made easy
  ☆16Updated 2 years ago
• khuyentran1401 / prefect-docker
  Demo on how to use Prefect with Docker
  ☆26Updated 2 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆29Updated 2 weeks ago
• jeantardelli / data-engineering-with-python
  Here I will be exploring various tools and methods that are used in data engineering process with Python.
  ☆22Updated 3 years ago
• GokuMohandas / feature-store
  Using a feature store to connect the DataOps and MLOps workflows to enable collaborative teams to develop efficiently.
  ☆53Updated 2 years ago
• feast-dev / feast-aws-credit-scoring-tutorial
  Feast AWS guide using Redshift / Spectrum / DynamoDB to build a credit scoring model
  ☆61Updated 3 years ago
• data-max-hq / ab-testing-in-ml
  Deploy A/B testing infrastructure in a containerized microservice architecture for Machine Learning applications.
  ☆39Updated last year
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆42Updated last year
• liartem / mlops-zoomcamp
  ☆14Updated last year
• karenbajador / pyspark_greatexpectations
  ☆11Updated 2 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆49Updated 3 months ago
• khuyentran1401 / prefect-mlops-recipes
  Tutorials/use cases of using Prefect in an ML project.
  ☆40Updated last year
• Wittline / pyspark-on-aws-emr
  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…
  ☆25Updated 2 years ago
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆56Updated last year
• itversity / databricks-certification-spark
  Databricks Certified Associate Spark Developer preparation toolkit to setup single node Standalone Spark Cluster along with material in t…
  ☆28Updated 6 months ago
• Minyus / kedro-starters-sklearn
  Kedro starter templates using Scikit-learn and optionally MLflow
  ☆9Updated 11 months ago
• khuyentran1401 / analyze_github_feed
  Create a local dashboard to visualize and filter your GitHub feed
  ☆29Updated 2 years ago
• elleobrien / automatic_testing
  ☆21Updated last year
• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆31Updated last year
• fastforwardlabs / cml_churn_demo_mlops
  ☆16Updated last year
• Stefen-Taime / modern-data-pipeline
  reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
  ☆12Updated last year
• anilkulkarni87 / airflow-docker
  This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …
  ☆27Updated 9 months ago
• jacobceles / intro-to-colab-pyspark-emr
  A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …
  ☆18Updated 3 years ago
• noahgift / mlflow-project-best-practices
  An example MLFlow project
  ☆48Updated 2 years ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆50Updated 2 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• itversity / data-engineering-spark
  ☆86Updated 2 years ago
• srivatsan88 / ContinousModelDeploy
  This is code depository for my upcoming session. Will update details post the session
  ☆40Updated last year
• Spratiher9 / Sparkora
  Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟
  ☆53Updated 2 years ago