spotify / luigiLinks
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,514Updated 4 months ago
Alternatives and similar repositories for luigi
Users that are interested in luigi are comparing it to the libraries listed below
Sorting:
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆42,676Updated this week
- Parallel computing with task scheduling☆13,509Updated last week
- Data-Centric Pipelines and Data Versioning☆6,259Updated 8 months ago
- Python Stream Processing☆6,824Updated last year
- A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…☆24,141Updated 3 weeks ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆20,480Updated last week
- the portable Python dataframe library☆6,129Updated last week
- Simple job queues for Python☆10,371Updated last week
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,896Updated last year
- 📚 Parameterize, execute, and analyze notebooks☆6,277Updated 2 months ago
- Python library that makes it easy for data scientists to create charts.☆3,614Updated 11 months ago
- Build, Manage and Deploy AI/ML Systems☆9,558Updated this week
- Sampling profiler for Python programs☆14,382Updated 3 weeks ago
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,451Updated last month
- Python composable command line interface toolkit☆16,873Updated last week
- Always know what to expect from your data.☆10,800Updated this week
- A next-generation curated knowledge sharing platform for data scientists and other technical professions.☆5,529Updated last year
- Python client for Apache Kafka☆5,820Updated last month
- Optional static typing for Python☆19,849Updated this week
- Ready-to-run Docker images containing Jupyter applications☆8,337Updated this week
- Data Apps & Dashboards for Python. No JavaScript Required.☆24,132Updated this week
- Python Development Workflow for Humans.☆25,099Updated 2 months ago
- Computing with Python functions.☆4,233Updated last week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,289Updated this week
- Ultra fast asyncio event loop.☆11,304Updated 5 months ago
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,368Updated this week
- Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.☆19,650Updated 2 weeks ago
- A functional standard library for Python.☆5,040Updated 3 months ago
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,911Updated this week
- Serverless Python☆11,875Updated 2 years ago