Alternatives and similar repositories for luigi

Users that are interested in luigi are comparing it to the libraries listed below

• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆42,858Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,535Updated last week
• google / python-fire
  Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.
  ☆27,933Updated 3 weeks ago
• pachyderm / pachyderm
  Data-Centric Pipelines and Data Versioning
  ☆6,259Updated 8 months ago
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,570Updated this week
• getredash / redash
  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
  ☆27,895Updated this week
• airbnb / knowledge-repo
  A next-generation curated knowledge sharing platform for data scientists and other technical professions.
  ☆5,528Updated last year
• robinhood / faust
  Python Stream Processing
  ☆6,824Updated last year
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆20,620Updated this week
• rq / rq
  Simple job queues for Python
  ☆10,389Updated last week
• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆14,228Updated this week
• plotly / dash
  Data Apps & Dashboards for Python. No JavaScript Required.
  ☆24,170Updated this week
• celery / celery
  Distributed Task Queue (development branch)
  ☆27,372Updated this week
• piskvorky / smart_open
  Utils for streaming large files (S3, HDFS, gzip, bz2...)
  ☆3,377Updated last week
• nteract / papermill
  📚 Parameterize, execute, and analyze notebooks
  ☆6,284Updated 2 weeks ago
• apache / superset
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆68,505Updated this week
• pditommaso / awesome-pipeline
  A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin
  ☆6,462Updated 2 months ago
• hugapi / hug
  Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
  ☆6,898Updated last year
• cookiecutter / cookiecutter
  A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…
  ☆24,184Updated last month
• great-expectations / great_expectations
  Always know what to expect from your data.
  ☆10,832Updated last week
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆16,082Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆6,172Updated this week
• vaexio / vaex
  Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…
  ☆8,436Updated 3 weeks ago
• python-pendulum / pendulum
  Python datetimes made easy
  ☆6,566Updated last month
• pallets / click
  Python composable command line interface toolkit
  ☆16,914Updated last week
• iterative / dvc
  🦉 Data Versioning and ML Experiments
  ☆14,984Updated last week
• vega / altair
  Declarative visualization library for Python
  ☆10,066Updated last week
• h2oai / h2o-3
  H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random F…
  ☆7,321Updated this week
• apache / pinot
  Apache Pinot - A realtime distributed OLAP datastore
  ☆5,921Updated last week
• kubeflow / kubeflow
  Machine Learning Toolkit for Kubernetes
  ☆15,246Updated 2 months ago