spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,259Updated 2 weeks ago
Alternatives and similar repositories for luigi:
Users that are interested in luigi are comparing it to the libraries listed below
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆39,979Updated this week
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,623Updated last week
- Data-Centric Pipelines and Data Versioning☆6,225Updated 3 months ago
- Serverless Python☆11,888Updated 2 years ago
- 📚 Parameterize, execute, and analyze notebooks☆6,153Updated last month
- Fuzzy String Matching in Python☆9,258Updated 2 years ago
- Declarative visualization library for Python☆9,759Updated this week
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆27,292Updated this week
- A next-generation curated knowledge sharing platform for data scientists and other technical professions.☆5,517Updated 8 months ago
- A formatter for Python files☆13,887Updated 2 weeks ago
- 🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…☆6,609Updated 2 months ago
- Sampling profiler for Python programs☆13,631Updated last month
- Data Apps & Dashboards for Python. No JavaScript Required.☆22,418Updated this week
- Parallel computing with task scheduling☆13,177Updated this week
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,884Updated 10 months ago
- Distributed Task Queue (development branch)☆26,283Updated this week
- Grumpy is a Python to Go source code transcompiler and runtime.☆10,544Updated 3 years ago
- Python datetimes made easy☆6,428Updated 2 weeks ago
- Python Development Workflow for Humans.☆25,050Updated last week
- Simple job queues for Python☆10,152Updated this week
- A Fast, Extensible Progress Bar for Python and CLI☆29,800Updated 3 months ago
- The no-magic web API and microservices framework for Python developers, with an emphasis on reliability and performance at scale.☆9,643Updated last week
- 🏹 Better dates & times for Python☆8,843Updated 5 months ago
- Real-time monitor and web admin for Celery distributed task queue☆6,742Updated 8 months ago
- Ready-to-run Docker images containing Jupyter applications☆8,201Updated this week
- Always know what to expect from your data.☆10,376Updated this week
- SQL for Humans™☆7,197Updated 10 months ago
- Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk☆13,728Updated 9 months ago
- 🍦 Never use print() to debug again.☆9,708Updated 2 weeks ago
- Extract Transform Load for Python 3.5+☆1,589Updated 2 years ago