Alternatives and similar repositories for airflow

Users that are interested in airflow are comparing it to the libraries listed below

• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,343Updated last month
• apache / superset
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆66,704Updated this week
• puckel / docker-airflow
  Docker Apache Airflow
  ☆3,806Updated 2 years ago
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆15,579Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,277Updated this week
• getredash / redash
  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
  ☆27,429Updated 2 weeks ago
• streamlit / streamlit
  Streamlit — A faster way to build and share data apps.
  ☆39,907Updated this week
• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆13,408Updated this week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,378Updated this week
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆19,550Updated this week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆10,990Updated this week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,159Updated this week
• ClickHouse / ClickHouse
  ClickHouse® is a real-time analytics database management system
  ☆41,284Updated this week
• celery / celery
  Distributed Task Queue (development branch)
  ☆26,612Updated this week
• apache / spark
  Apache Spark - A unified analytics engine for large-scale data processing
  ☆41,321Updated this week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,744Updated this week
• prometheus / prometheus
  The Prometheus monitoring system and time series database.
  ☆58,982Updated this week
• grafana / grafana
  The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Pro…
  ☆68,484Updated this week
• google / python-fire
  Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.
  ☆27,707Updated 2 weeks ago
• ray-project / ray
  Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
  ☆37,558Updated this week
• python-poetry / poetry
  Python packaging and dependency management made easy
  ☆33,338Updated this week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,480Updated this week
• dpkp / kafka-python
  Python client for Apache Kafka
  ☆5,759Updated this week
• minio / minio
  MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.
  ☆53,171Updated last week
• microsoft / pyright
  Static Type Checker for Python
  ☆14,447Updated this week
• metabase / metabase
  The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data
  ☆42,351Updated this week
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,088Updated this week
• iterative / dvc
  🦉 Data Versioning and ML Experiments
  ☆14,563Updated this week
• influxdata / influxdb
  Scalable datastore for metrics, events, and real-time analytics
  ☆30,173Updated this week
• apache / iceberg
  Apache Iceberg
  ☆7,584Updated this week