spotify / luigiLinks
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,459Updated 3 months ago
Alternatives and similar repositories for luigi
Users that are interested in luigi are comparing it to the libraries listed below
Sorting:
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆41,834Updated this week
- Interactive Data Visualization in the browser, from Python☆20,076Updated this week
- Parallel computing with task scheduling☆13,448Updated last week
- Python composable command line interface toolkit☆16,804Updated last week
- Python Stream Processing☆6,821Updated last year
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,438Updated 2 weeks ago
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,853Updated this week
- Declarative visualization library for Python☆9,987Updated this week
- Simple job queues for Python☆10,323Updated last week
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,893Updated last year
- An orchestration platform for the development, production, and observation of data assets.☆13,922Updated this week
- the portable Python dataframe library☆6,073Updated this week
- The no-magic web API and microservices framework for Python developers, with a focus on reliability and performance at scale.☆9,710Updated this week
- Python Development Workflow for Humans.☆25,089Updated last month
- Apache Superset is a Data Visualization and Data Exploration Platform☆67,802Updated this week
- A formatter for Python files☆13,945Updated 2 weeks ago
- Simple, Pythonic remote execution and deployment.☆15,219Updated last month
- Python packaging and dependency management made easy☆33,881Updated this week
- A suite of utilities for converting to and working with CSV, the king of tabular file formats.☆6,243Updated 3 weeks ago
- The property-based testing library for Python☆8,052Updated this week
- Write scalable load tests in plain Python 🚗💨☆26,698Updated last week
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆27,719Updated this week
- Build, Manage and Deploy AI/ML Systems☆9,439Updated this week
- The Web API toolkit. 🛠☆5,558Updated 3 years ago
- Computing with Python functions.☆4,203Updated last week
- Python datetimes made easy☆6,542Updated last week
- Python logging made (stupidly) simple☆22,596Updated this week
- GraphQL framework for Python☆8,207Updated 9 months ago
- REST API for any Postgres database☆25,665Updated this week
- Python client for Apache Kafka☆5,800Updated 2 weeks ago