Alternatives and similar repositories for airflow

Users that are interested in airflow are comparing it to the libraries listed below

• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,522Updated 4 months ago
• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆14,177Updated this week
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆20,518Updated last week
• dask / dask
  Parallel computing with task scheduling
  ☆13,518Updated this week
• metabase / metabase
  The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data
  ☆44,027Updated this week
• apache / superset
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆68,408Updated this week
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆16,031Updated last week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,842Updated this week
• mlflow / mlflow
  The open source developer platform to build AI/LLM applications and models with confidence. Enhance your AI applications with end-to-end …
  ☆22,392Updated this week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,323Updated last week
• airbytehq / airbyte
  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…
  ☆19,729Updated this week
• pachyderm / pachyderm
  Data-Centric Pipelines and Data Versioning
  ☆6,256Updated 8 months ago
• ClickHouse / ClickHouse
  ClickHouse® is a real-time analytics database management system
  ☆43,279Updated this week
• kubeflow / kubeflow
  Machine Learning Toolkit for Kubernetes
  ☆15,233Updated 2 months ago
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,310Updated this week
• timescale / timescaledb
  A time-series database for high-performance real-time analytics packaged as a Postgres extension
  ☆20,397Updated this week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,519Updated this week
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,590Updated this week
• influxdata / influxdb
  Scalable datastore for metrics, events, and real-time analytics
  ☆30,723Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆6,149Updated this week
• apache / pinot
  Apache Pinot - A realtime distributed OLAP datastore
  ☆5,916Updated this week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,816Updated this week
• duckdb / duckdb
  DuckDB is an analytical in-process SQL database management system
  ☆33,352Updated this week
• getredash / redash
  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
  ☆27,839Updated last week
• prometheus / prometheus
  The Prometheus monitoring system and time series database.
  ☆60,726Updated this week
• grafana / grafana
  The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Pro…
  ☆70,309Updated this week
• jupyterlab / jupyterlab
  JupyterLab computational environment.
  ☆14,826Updated this week
• kubernetes / minikube
  Run Kubernetes locally
  ☆31,026Updated this week
• containerd / containerd
  An open and reliable container runtime
  ☆19,389Updated this week
• iterative / dvc
  🦉 Data Versioning and ML Experiments
  ☆14,948Updated this week