spotify / luigiLinks
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,652Updated this week
Alternatives and similar repositories for luigi
Users that are interested in luigi are comparing it to the libraries listed below
Sorting:
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆44,172Updated this week
- Data Apps & Dashboards for Python. No JavaScript Required.☆24,458Updated this week
- Data-Centric Pipelines and Data Versioning☆6,288Updated last year
- Parallel computing with task scheduling☆13,727Updated this week
- Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.☆19,982Updated last week
- Build, Manage and Deploy AI/ML Systems☆9,746Updated this week
- A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…☆24,642Updated last week
- Python Stream Processing☆6,835Updated last year
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,518Updated 3 months ago
- 🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…☆6,849Updated last week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆21,507Updated last week
- Simple job queues for Python☆10,570Updated last week
- Distributed Task Queue (development branch)☆27,977Updated this week
- Python datetimes made easy☆6,615Updated last week
- the portable Python dataframe library☆6,385Updated this week
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,905Updated last year
- A formatter for Python files☆13,980Updated 2 weeks ago
- Declarative visualization library for Python☆10,232Updated 2 weeks ago
- A next-generation curated knowledge sharing platform for data scientists and other technical professions.☆5,540Updated last year
- The property-based testing library for Python☆8,432Updated this week
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆28,204Updated this week
- Statistical data visualization in Python☆13,709Updated 2 weeks ago
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,468Updated this week
- A functional standard library for Python.☆5,112Updated last month
- A suite of utilities for converting to and working with CSV, the king of tabular file formats.☆6,338Updated 3 weeks ago
- Interactive Data Visualization in the browser, from Python☆20,322Updated this week
- A collection of design patterns/idioms in Python☆42,729Updated 2 weeks ago
- 📚 Parameterize, execute, and analyze notebooks☆6,367Updated last month
- Always know what to expect from your data.☆11,110Updated this week
- SQL for Humans™☆7,226Updated last year