Minyus / Python_Packages_for_Pipeline_Workflow
This article compares open-source Python packages for pipeline/workflow development: Airflow, Luigi, Gokart, Metaflow, Kedro, PipelineX.
☆56Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for Python_Packages_for_Pipeline_Workflow
- PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more☆224Updated 11 months ago
- Kedro Wings automatically creates catalog entries to simplify Kedro pipeline writing. See the video here: https://www.youtube.com/watch?v…☆22Updated last year
- The easiest way to integrate Kedro and Great Expectations☆53Updated last year
- 🐍 Material for PyData Global 2021 Presentation: Effective Testing for Machine Learning Projects☆81Updated 2 years ago
- Automatically export Jupyter notebooks to various file formats (.py, .html, and more) on save.☆73Updated 9 months ago
- ☆43Updated last year
- Templates for your Kedro projects.☆66Updated this week
- 🍦 Deployment tool for online machine learning models☆97Updated 2 years ago
- Examples of data science projects created with Kedro.☆171Updated last year
- Kedro-Accelerator speeds up pipelines by parallelizing I/O in the background.☆35Updated 2 years ago
- An abstraction layer for parameter tuning☆36Updated 2 months ago
- A scikit-learn compatible estimator based on business-rules with interactive dashboard included☆28Updated 3 years ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆111Updated 7 months ago
- kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.☆27Updated last year
- Plugins, extensions, case studies, articles, and video tutorials for Kedro☆63Updated 3 weeks ago
- A tool to deploy a mostly serverless MLflow tracking server on a GCP project with one command☆66Updated last year
- First-party plugins maintained by the Kedro team.☆93Updated this week
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆52Updated 2 months ago
- ☆17Updated 11 months ago
- Sample projects using Ploomber.☆83Updated 9 months ago
- ☄️ Parallel and distributed training with spaCy and Ray☆54Updated last year
- A kedro-plugin for integration of mlflow capabilities inside kedro projects (especially machine learning model versioning and packaging)☆203Updated this week
- Convert monolithic Jupyter notebooks 📙 into maintainable Ploomber pipelines. 📊☆78Updated last month
- HiPlot fetcher for experiments logged with MLflow☆13Updated 2 years ago
- Viewer for Altair and Vega-Lite visualizations☆81Updated 7 months ago
- Automated Data Science and Machine Learning library to optimize workflow.☆104Updated last year
- A small python library that can clump lists of data together.☆147Updated 2 years ago
- SciKIt-learn Pipeline in PAndas☆42Updated last year