spotify / luigiLinks
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,423Updated 2 months ago
Alternatives and similar repositories for luigi
Users that are interested in luigi are comparing it to the libraries listed below
Sorting:
- Parallel computing with task scheduling☆13,396Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆41,565Updated this week
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,432Updated 5 months ago
- Build, Manage and Deploy AI/ML Systems☆9,392Updated this week
- Data-Centric Pipelines and Data Versioning☆6,248Updated 6 months ago
- 📚 Parameterize, execute, and analyze notebooks☆6,236Updated last month
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆20,047Updated this week
- A formatter for Python files☆13,935Updated last month
- Python Stream Processing☆6,816Updated last year
- Interactive Data Visualization in the browser, from Python☆20,031Updated this week
- Statistical data visualization in Python☆13,365Updated last month
- The no-magic web API and microservices framework for Python developers, with a focus on reliability and performance at scale.☆9,701Updated this week
- Simple job queues for Python☆10,295Updated this week
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,823Updated last week
- A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…☆23,951Updated this week
- Computing with Python functions.☆4,142Updated 2 months ago
- Modin: Scale your Pandas workflows by changing a single line of code☆10,260Updated this week
- 📘 The interactive computing suite for you! ✨☆6,257Updated last year
- NumPy and Pandas interface to Big Data☆3,200Updated last year
- Python composable command line interface toolkit☆16,723Updated last week
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,894Updated last year
- JupyterLab computational environment.☆14,746Updated this week
- the portable Python dataframe library☆6,000Updated this week
- Official repository for IPython itself. Other repos in the IPython organization contain things like the website, documentation builds, et…☆16,535Updated last week
- 🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…☆6,698Updated 5 months ago
- Data Apps & Dashboards for Python. No JavaScript Required.☆23,937Updated this week
- Simple, Pythonic remote execution and deployment.☆15,203Updated 3 weeks ago
- Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts☆6,955Updated this week
- Multi-user server for Jupyter notebooks☆8,092Updated last week
- Declarative visualization library for Python☆9,939Updated 3 weeks ago