spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆17,705Updated last week
Related projects: ⓘ
- A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…☆22,314Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆36,304Updated this week
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆26,886Updated 2 weeks ago
- A formatter for Python files☆13,735Updated this week
- Parallel computing with task scheduling☆12,405Updated this week
- Data Apps & Dashboards for Python. No JavaScript Required.☆21,166Updated this week
- Distributed Task Queue (development branch)☆24,491Updated this week
- Python composable command line interface toolkit☆15,532Updated 2 weeks ago
- Python Stream Processing☆6,722Updated last month
- Python Development Workflow for Humans.☆24,812Updated this week
- Accelerate your web app development | Build fast. Run fast.☆18,006Updated last month
- The no-magic web data plane API and microservices framework for Python developers, with a focus on reliability, correctness, and performa…☆9,507Updated this week
- Interactive Data Visualization in the browser, from Python☆19,227Updated this week
- Serverless Python☆11,887Updated last year
- Faker is a Python package that generates fake data for you.☆17,585Updated 2 weeks ago
- Python job scheduling for humans.☆11,731Updated 3 months ago
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,859Updated 2 months ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆15,830Updated this week
- Simple job queues for Python☆9,796Updated this week
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆25,928Updated this week
- A Fast, Extensible Progress Bar for Python and CLI☆28,340Updated last month
- 🦉 ML Experiments and Data Management with Git☆13,608Updated this week
- Python packaging and dependency management made easy☆31,084Updated this week
- Optional static typing for Python☆18,205Updated this week
- A very fast and expressive template engine.☆10,245Updated last week
- Hypothesis is a powerful, flexible, and easy to use library for property-based testing.☆7,505Updated this week
- Machine Learning Toolkit for Kubernetes☆14,193Updated this week
- Ready-to-run Docker images containing Jupyter applications☆7,911Updated this week
- Ultra fast asyncio event loop.☆10,274Updated 2 weeks ago
- Asynchronous HTTP client/server framework for asyncio and Python☆14,959Updated this week