Alternatives and similar repositories for airflow

Users that are interested in airflow are comparing it to the libraries listed below

• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,464Updated 3 months ago
• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆13,961Updated last week
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆20,315Updated this week
• apache / superset
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆67,905Updated last week
• getredash / redash
  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
  ☆27,751Updated this week
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆15,929Updated this week
• airbytehq / airbyte
  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…
  ☆19,468Updated this week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,291Updated this week
• scrapy / scrapy
  Scrapy, a fast high-level web crawling & scraping framework for Python.
  ☆58,182Updated last week
• apache / spark
  Apache Spark - A unified analytics engine for large-scale data processing
  ☆41,850Updated this week
• pditommaso / awesome-pipeline
  A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin
  ☆6,441Updated 3 weeks ago
• dask / dask
  Parallel computing with task scheduling
  ☆13,462Updated last week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,487Updated last week
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,453Updated this week
• celery / celery
  Distributed Task Queue (development branch)
  ☆27,160Updated this week
• metabase / metabase
  The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data
  ☆43,560Updated last week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,821Updated this week
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,722Updated this week
• kubeflow / kubeflow
  Machine Learning Toolkit for Kubernetes
  ☆15,173Updated last month
• argoproj / argo-workflows
  Workflow Engine for Kubernetes
  ☆16,003Updated this week
• prometheus / prometheus
  The Prometheus monitoring system and time series database.
  ☆60,261Updated this week
• plotly / dash
  Data Apps & Dashboards for Python. No JavaScript Required.
  ☆24,021Updated this week
• cookiecutter / cookiecutter
  A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…
  ☆24,057Updated this week
• traefik / traefik
  The Cloud Native Application Proxy
  ☆56,567Updated this week
• ClickHouse / ClickHouse
  ClickHouse® is a real-time analytics database management system
  ☆42,738Updated last week
• flyteorg / flyte
  Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
  ☆6,488Updated this week
• pandas-dev / pandas
  Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects,…
  ☆46,496Updated last week
• bazelbuild / bazel
  a fast, scalable, multi-language and extensible build system
  ☆24,520Updated last week
• juicedata / juicefs
  JuiceFS is a distributed POSIX file system built on top of Redis and S3.
  ☆12,123Updated this week
• streamlit / streamlit
  Streamlit — A faster way to build and share data apps.
  ☆41,272Updated this week