Alternatives and similar repositories for airflow:

Users that are interested in airflow are comparing it to the libraries listed below

• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,024Updated this week
• prometheus / prometheus
  The Prometheus monitoring system and time series database.
  ☆56,847Updated this week
• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆12,300Updated this week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,155Updated this week
• apache / superset
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆63,827Updated this week
• apache / spark
  Apache Spark - A unified analytics engine for large-scale data processing
  ☆40,326Updated this week
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆18,036Updated this week
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆14,846Updated this week
• tensorflow / tensorflow
  An Open Source Machine Learning Framework for Everyone
  ☆187,272Updated this week
• grafana / grafana
  The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Pro…
  ☆65,917Updated this week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,593Updated this week
• getredash / redash
  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
  ☆26,754Updated this week
• puckel / docker-airflow
  Docker Apache Airflow
  ☆3,790Updated last year
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆7,755Updated this week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,117Updated this week
• ClickHouse / ClickHouse
  ClickHouse® is a real-time analytics database management system
  ☆38,472Updated this week
• facebook / rocksdb
  A library that provides an embeddable, persistent key-value store for fast storage.
  ☆28,975Updated this week
• Netflix / metaflow
  Open Source AI/ML Platform
  ☆8,446Updated this week
• minio / minio
  MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.
  ☆49,484Updated this week
• apache / kafka
  Mirror of Apache Kafka
  ☆29,248Updated this week
• grafana / loki
  Like Prometheus, but for logs.
  ☆24,373Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆12,851Updated this week
• pingcap / tidb
  TiDB - the open-source, cloud-native, distributed SQL database designed for modern applications.
  ☆37,734Updated this week
• ray-project / ray
  Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
  ☆34,903Updated this week
• kubeflow / kubeflow
  Machine Learning Toolkit for Kubernetes
  ☆14,544Updated last month
• hypermodeinc / dgraph
  high-performance graph database for real-time use cases
  ☆20,582Updated this week
• etcd-io / etcd
  Distributed reliable key-value store for the most critical data of a distributed system
  ☆48,212Updated this week
• timescale / timescaledb
  A time-series database for high-performance real-time analytics packaged as a Postgres extension
  ☆18,199Updated this week
• elastic / logstash
  Logstash - transport and process your logs, events, or other data
  ☆14,316Updated this week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆10,231Updated this week