Alternatives and similar repositories for airflow

Users that are interested in airflow are comparing it to the libraries listed below

• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,423Updated 2 months ago
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,800Updated this week
• apache / superset
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆67,526Updated this week
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆20,047Updated this week
• puckel / docker-airflow
  Docker Apache Airflow
  ☆3,811Updated 2 years ago
• dask / dask
  Parallel computing with task scheduling
  ☆13,396Updated this week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆11,231Updated this week
• apache / nifi
  Apache NiFi
  ☆5,585Updated this week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,233Updated this week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,445Updated this week
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,202Updated last week
• getredash / redash
  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
  ☆27,640Updated last week
• kubeflow / kubeflow
  Machine Learning Toolkit for Kubernetes
  ☆15,129Updated 3 weeks ago
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆15,811Updated last week
• ClickHouse / ClickHouse
  ClickHouse® is a real-time analytics database management system
  ☆42,279Updated this week
• cloudera / hue
  Open source SQL Query Assistant service for Databases/Warehouses
  ☆1,305Updated last week
• apache / pulsar
  Apache Pulsar - distributed pub-sub messaging system
  ☆14,788Updated this week
• celery / celery
  Distributed Task Queue (development branch)
  ☆27,001Updated this week
• azkaban / azkaban
  Azkaban workflow manager.
  ☆4,507Updated last year
• apache / pinot
  Apache Pinot - A realtime distributed OLAP datastore
  ☆5,866Updated this week
• meirwah / awesome-workflow-engines
  A curated list of awesome open source workflow engines
  ☆7,261Updated 3 months ago
• apache / spark
  Apache Spark - A unified analytics engine for large-scale data processing
  ☆41,661Updated this week
• cadence-workflow / cadence
  Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logi…
  ☆8,811Updated this week
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,392Updated this week
• trinodb / trino
  Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
  ☆11,723Updated this week
• metabase / metabase
  The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data
  ☆43,183Updated this week
• argoproj / argo-workflows
  Workflow Engine for Kubernetes
  ☆15,917Updated this week
• apache / zeppelin
  Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
  ☆6,543Updated this week
• mlflow / mlflow
  The open source developer platform to build AI/LLM applications and models with confidence. Enhance your AI applications with end-to-end …
  ☆21,542Updated this week
• amundsen-io / amundsen
  Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…
  ☆4,625Updated 2 weeks ago