spotify / luigiLinks
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,549Updated 5 months ago
Alternatives and similar repositories for luigi
Users that are interested in luigi are comparing it to the libraries listed below
Sorting:
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆43,147Updated this week
- Parallel computing with task scheduling☆13,577Updated this week
- Python Stream Processing☆6,824Updated last year
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,472Updated 2 weeks ago
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,958Updated last week
- Data-Centric Pipelines and Data Versioning☆6,263Updated 9 months ago
- A next-generation curated knowledge sharing platform for data scientists and other technical professions.☆5,533Updated last year
- Data Apps & Dashboards for Python. No JavaScript Required.☆24,232Updated this week
- Build, Manage and Deploy AI/ML Systems☆9,615Updated this week
- Machine Learning Toolkit for Kubernetes☆15,270Updated last week
- 📚 Parameterize, execute, and analyze notebooks☆6,303Updated last month
- Interactive Data Visualization in the browser, from Python☆20,179Updated this week
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,904Updated last year
- An orchestration platform for the development, production, and observation of data assets.☆14,367Updated this week
- A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow☆2,085Updated last year
- A formatter for Python files☆13,960Updated 3 weeks ago
- A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…☆24,291Updated this week
- Distributed Task Queue (development branch)☆27,515Updated last week
- Connexion is a modern Python web framework that makes spec-first and api-first development easy.☆4,571Updated last week
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,444Updated last week
- 🦉 Data Versioning and ML Experiments☆15,059Updated last week
- NumPy and Pandas interface to Big Data☆3,200Updated 2 years ago
- Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.☆19,750Updated 2 weeks ago
- the portable Python dataframe library☆6,188Updated last week
- Simple job queues for Python☆10,425Updated 2 weeks ago
- 🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…☆6,771Updated last month
- 📘 The interactive computing suite for you! ✨☆6,267Updated last year
- Always know what to expect from your data.☆10,898Updated this week
- Apache Superset is a Data Visualization and Data Exploration Platform☆68,839Updated this week
- Extract Transform Load for Python 3.5+☆1,604Updated 2 years ago