Alternatives and similar repositories for airflow

Users that are interested in airflow are comparing it to the libraries listed below

• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆14,126Updated this week
• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,498Updated 4 months ago
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆20,480Updated this week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆11,444Updated this week
• apache / superset
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆68,334Updated this week
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,491Updated this week
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,301Updated this week
• getredash / redash
  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
  ☆27,806Updated last week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,833Updated last week
• airbytehq / airbyte
  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…
  ☆19,687Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,509Updated last week
• argoproj / argo-workflows
  Workflow Engine for Kubernetes
  ☆16,053Updated this week
• kubeflow / kubeflow
  Machine Learning Toolkit for Kubernetes
  ☆15,225Updated last month
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆16,010Updated this week
• apache / iceberg
  Apache Iceberg
  ☆8,014Updated this week
• datahub-project / datahub
  The Metadata Platform for your Data and AI Stack
  ☆11,086Updated this week
• Kong / kong
  🦍 The Cloud-Native Gateway for APIs & AI
  ☆41,880Updated this week
• azkaban / azkaban
  Azkaban workflow manager.
  ☆4,515Updated last year
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,307Updated this week
• prometheus / prometheus
  The Prometheus monitoring system and time series database.
  ☆60,560Updated last week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,512Updated last week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,800Updated this week
• flyteorg / flyte
  Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
  ☆6,525Updated this week
• mlflow / mlflow
  The open source developer platform to build AI/LLM applications and models with confidence. Enhance your AI applications with end-to-end …
  ☆22,293Updated this week
• ClickHouse / ClickHouse
  ClickHouse® is a real-time analytics database management system
  ☆43,161Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆6,129Updated last week
• istio / istio
  Connect, secure, control, and observe services.
  ☆37,469Updated this week
• celery / celery
  Distributed Task Queue (development branch)
  ☆27,269Updated this week
• fabric / fabric
  Simple, Pythonic remote execution and deployment.
  ☆15,255Updated 2 months ago
• apache / spark
  Apache Spark - A unified analytics engine for large-scale data processing
  ☆41,998Updated this week