spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,259Updated 2 weeks ago
Alternatives and similar repositories for luigi:
Users that are interested in luigi are comparing it to the libraries listed below
- Parallel computing with task scheduling☆13,177Updated this week
- Serverless Python☆11,888Updated 2 years ago
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,611Updated last week
- 📚 Parameterize, execute, and analyze notebooks☆6,153Updated last month
- A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…☆23,465Updated last week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,145Updated this week
- Python composable command line interface toolkit☆16,317Updated last week
- Data-Centric Pipelines and Data Versioning☆6,223Updated 3 months ago
- 📘 The interactive computing suite for you! ✨☆6,247Updated last year
- Python library that makes it easy for data scientists to create charts.☆3,585Updated 6 months ago
- Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.☆19,161Updated 6 months ago
- A data science IDE for Python☆3,915Updated 7 years ago
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,352Updated last month
- Python Serverless Microframework for AWS☆10,839Updated last week
- Python helpers for building dashboards using Flask and React☆2,270Updated 7 years ago
- Multi-user server for Jupyter notebooks☆8,005Updated this week
- A formatter for Python files☆13,883Updated last week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆39,921Updated this week
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,380Updated 7 months ago
- Declarative visualization library for Python☆9,746Updated last week
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,881Updated 10 months ago
- A next-generation curated knowledge sharing platform for data scientists and other technical professions.☆5,517Updated 8 months ago
- The no-magic web API and microservices framework for Python developers, with an emphasis on reliability and performance at scale.☆9,643Updated last week
- NumPy and Pandas interface to Big Data☆3,199Updated last year
- gunicorn 'Green Unicorn' is a WSGI HTTP Server for UNIX, fast clients and sleepy applications.☆10,094Updated last month
- A Python library that generates static type annotations by collecting runtime types☆4,880Updated 9 months ago
- ReactiveX for Python☆4,898Updated last month
- Python Development Workflow for Humans.☆25,050Updated this week
- An open source python library for automated feature engineering☆7,436Updated this week
- Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts☆6,837Updated last week