spotify / luigiLinks
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
☆18,378Updated 2 months ago
Alternatives and similar repositories for luigi
Users that are interested in luigi are comparing it to the libraries listed below
Sorting:
- Parallel computing with task scheduling☆13,360Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆41,186Updated this week
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,411Updated 4 months ago
- Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.☆6,893Updated last year
- A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C proje…☆23,821Updated last week
- Always know what to expect from your data.☆10,586Updated this week
- A formatter for Python files☆13,921Updated 3 weeks ago
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆27,765Updated this week
- The property-based testing library for Python☆7,930Updated this week
- Data-Centric Pipelines and Data Versioning☆6,243Updated 5 months ago
- REST API framework designed for human beings☆6,731Updated last month
- Serverless Python☆11,883Updated 2 years ago
- Python composable command line interface toolkit☆16,661Updated this week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆19,825Updated this week
- Build, Manage and Deploy AI/ML Systems☆9,254Updated this week
- Python Stream Processing☆6,808Updated 11 months ago
- 🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…☆6,678Updated 5 months ago
- Python datetimes made easy☆6,498Updated last week
- Python Serverless Microframework for AWS☆10,890Updated last month
- Connexion is a modern Python web framework that makes spec-first and api-first development easy.☆4,553Updated 2 weeks ago
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆27,555Updated this week
- the portable Python dataframe library☆5,939Updated this week
- SQL for Humans™☆7,208Updated last year
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,336Updated 2 weeks ago
- Faker is a Python package that generates fake data for you.☆18,561Updated last week
- 📚 Parameterize, execute, and analyze notebooks☆6,226Updated 2 weeks ago
- The no-magic web API and microservices framework for Python developers, with an emphasis on reliability and performance at scale.☆9,692Updated this week
- Accelerate your web app development | Build fast. Run fast.☆18,445Updated 3 weeks ago
- A next-generation curated knowledge sharing platform for data scientists and other technical professions.☆5,528Updated 10 months ago
- An orchestration platform for the development, production, and observation of data assets.☆13,636Updated this week