Alternatives and similar repositories for airflow

Users that are interested in airflow are comparing it to the libraries listed below

• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,557Updated 6 months ago
• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆14,421Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,590Updated this week
• apache / superset
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆68,951Updated this week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,362Updated this week
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆16,138Updated this week
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆20,803Updated this week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,564Updated this week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,869Updated this week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆11,829Updated this week
• pachyderm / pachyderm
  Data-Centric Pipelines and Data Versioning
  ☆6,265Updated 9 months ago
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,627Updated this week
• argoproj / argo-workflows
  Workflow Engine for Kubernetes
  ☆16,174Updated this week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,919Updated this week
• timescale / timescaledb
  A time-series database for high-performance real-time analytics packaged as a Postgres extension
  ☆20,649Updated this week
• influxdata / influxdb
  Scalable datastore for metrics, events, and real-time analytics
  ☆30,792Updated last week
• envoyproxy / envoy
  Cloud-native high-performance edge/middle/service proxy
  ☆27,001Updated this week
• apache / spark
  Apache Spark - A unified analytics engine for large-scale data processing
  ☆42,266Updated this week
• jaegertracing / jaeger
  CNCF Jaeger, a Distributed Tracing Platform
  ☆22,104Updated this week
• python-poetry / poetry
  Python packaging and dependency management made easy
  ☆34,037Updated this week
• pditommaso / awesome-pipeline
  A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin
  ☆6,473Updated 3 weeks ago
• ibis-project / ibis
  the portable Python dataframe library
  ☆6,205Updated this week
• duckdb / duckdb
  DuckDB is an analytical in-process SQL database management system
  ☆34,025Updated this week
• getredash / redash
  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
  ☆27,955Updated this week
• datahub-project / datahub
  The Metadata Platform for your Data and AI Stack
  ☆11,201Updated this week
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,390Updated this week
• locustio / locust
  Write scalable load tests in plain Python 🚗💨
  ☆27,070Updated last week
• prometheus / prometheus
  The Prometheus monitoring system and time series database.
  ☆61,305Updated this week
• vectordotdev / vector
  A high-performance observability data pipeline.
  ☆20,732Updated this week
• fluent / fluentd
  Fluentd: Unified Logging Layer (project under CNCF)
  ☆13,382Updated last week