Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,748Jun 19, 2026Updated last week
Alternatives and similar repositories for luigi
Users that are interested in luigi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆45,915Jun 25, 2026Updated last week
- Parallel computing with task scheduling☆13,856Updated this week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆22,701Updated this week
- Apache Superset is a Data Visualization and Data Exploration Platform☆73,566Updated this week
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆28,660Jun 25, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆28,215Apr 1, 2026Updated 3 months ago
- An orchestration platform for the development, production, and observation of data assets.☆15,763Jun 25, 2026Updated last week
- A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…☆24,969Apr 1, 2026Updated 3 months ago
- Pinball is a scalable workflow manager☆1,047Dec 10, 2019Updated 6 years ago
- Distributed Task Queue (development branch)☆28,626Jun 24, 2026Updated last week
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,592Jun 16, 2026Updated 2 weeks ago
- Python Development Workflow for Humans.☆25,060Jun 24, 2026Updated last week
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆33,697May 19, 2026Updated last month
- Python Stream Processing☆6,822Jul 27, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Data-Centric Pipelines and Data Versioning☆6,296Feb 3, 2025Updated last year
- Serverless Python☆11,837Mar 23, 2023Updated 3 years ago
- Accelerate your web app development | Build fast. Run fast.☆18,627May 31, 2026Updated last month
- Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk☆14,254Oct 29, 2025Updated 8 months ago
- Data Apps & Dashboards for Python. No JavaScript Required.☆24,271Jun 23, 2026Updated last week
- Python packaging and dependency management made easy☆34,292Jun 22, 2026Updated last week
- Simple job queues for Python☆10,658Jun 24, 2026Updated last week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆43,025Updated this week
- Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.☆20,262May 8, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Interactive Data Visualization in the browser, from Python☆20,408Updated this week
- A formatter for Python files☆13,980Updated this week
- Build, Manage and Deploy AI/ML Systems☆10,143Jun 24, 2026Updated last week
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,883Jul 4, 2024Updated last year
- 🦉 Data Versioning and ML Experiments☆15,708Jun 24, 2026Updated last week
- The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data☆47,905Updated this week
- The no-magic web API and microservices framework for Python developers, with a focus on reliability and performance at scale.☆9,797Jun 17, 2026Updated 2 weeks ago
- The uncompromising Python code formatter☆41,585Jun 24, 2026Updated last week
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆26,741Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Write scalable load tests in plain Python 🚗💨☆27,950Updated this week
- Python composable command line interface toolkit☆17,553Updated this week
- Ultra fast asyncio event loop.☆11,838May 4, 2026Updated last month
- 📚 Parameterize, execute, and analyze notebooks☆6,456May 12, 2026Updated last month
- A Fast, Extensible Progress Bar for Python and CLI☆31,217Jun 17, 2026Updated 2 weeks ago
- Optional static typing for Python☆20,500Updated this week
- Machine Learning Toolkit for Kubernetes☆15,750Jun 18, 2026Updated 2 weeks ago