This article compares open-source Python packages for pipeline/workflow development: Airflow, Luigi, Gokart, Metaflow, Kedro, PipelineX.
☆56Jul 10, 2020Updated 5 years ago
Alternatives and similar repositories for Python_Packages_for_Pipeline_Workflow
Users that are interested in Python_Packages_for_Pipeline_Workflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more☆228Apr 12, 2026Updated last week
- ☆25Apr 5, 2023Updated 3 years ago
- kedro plugin to automatically construct pipelines using pytest style pattern matching☆22Sep 4, 2025Updated 7 months ago
- A GitHub Action to lint, test, build-docs, package, and run your kedro pipelines. Supports any Python version you'll give it (that is als…☆19Feb 8, 2026Updated 2 months ago
- Extension to hypothesis for testing numpy general universal functions☆37Mar 25, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Datasette plugin providing instructions for exporting data to Jupyter or Observable☆13Sep 15, 2023Updated 2 years ago
- Examples of data science projects created with Kedro.☆175Jun 2, 2023Updated 2 years ago
- A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models☆17Updated this week
- Curated collection of DE1's favorite kedro pieces.☆12Apr 5, 2024Updated 2 years ago
- A simple wrapper to use Pandas Profiling easily in Kedro☆17Apr 12, 2021Updated 5 years ago
- A faster multi-way merge algorithm interchangeable with heapq.merge☆23Jul 11, 2023Updated 2 years ago
- Source code for the VLDB 2021 paper.☆11May 19, 2021Updated 4 years ago
- ☆12Aug 27, 2024Updated last year
- A Kedro plugin that provides pandas dropin replacements for the pandas datasets (e.g modin and cuDF)☆12Feb 2, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆12Aug 29, 2015Updated 10 years ago
- An implementation of Simulated Annealing for FCEUX Lua Script to search NES input sequence automatically.☆20Jan 11, 2015Updated 11 years ago
- A kedro-plugin to serve Kedro Pipelines as API☆13Jun 25, 2023Updated 2 years ago
- Set-oriented Operations in Pandas☆24May 27, 2020Updated 5 years ago
- ☆15Sep 3, 2019Updated 6 years ago
- A boilerplate for DBI drivers, fully DBI-compliant☆11Mar 20, 2026Updated 3 weeks ago
- R package for user friendly Facebook scraping☆10Jul 6, 2017Updated 8 years ago
- ☆12Sep 19, 2018Updated 7 years ago
- ☆12May 1, 2021Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆12Nov 9, 2018Updated 7 years ago
- Datalog based relational programming in Python.☆15Dec 26, 2022Updated 3 years ago
- Access Amazon's AWS Athena API via reticulate and AWS official Python boto3 module☆10Sep 24, 2018Updated 7 years ago
- The easiest way to integrate Kedro and Great Expectations☆54Dec 26, 2022Updated 3 years ago
- ☆32Dec 15, 2023Updated 2 years ago
- A repository of codes in learning deep learning☆13May 14, 2018Updated 7 years ago
- UNMAINTAINED. 2013☆22Oct 17, 2013Updated 12 years ago
- Kedro Wings automatically creates catalog entries to simplify Kedro pipeline writing. See the video here: https://www.youtube.com/watch?v…☆21Dec 26, 2022Updated 3 years ago
- Techcrunch Incremental Scrapy Spider With MongoDB☆16Dec 25, 2018Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Bidirectional transformation for Relational view update Datalog-based Strategies☆22Jul 5, 2023Updated 2 years ago
- R dplyr connector for ImpalaDB☆15Mar 1, 2017Updated 9 years ago
- R package for IP addresses☆15Sep 20, 2015Updated 10 years ago
- ☆15Updated this week
- Kedro extension for VSCode including LSP and other features☆21Updated this week
- Python&機械学習ライブラリ scikit-learn の使い方の練習コード集。機械学習の理論解説付き☆16Dec 2, 2018Updated 7 years ago
- this is a parse cloud module to send template mails from mandrill☆13Apr 26, 2014Updated 11 years ago