Minyus / Python_Packages_for_Pipeline_Workflow
This article compares open-source Python packages for pipeline/workflow development: Airflow, Luigi, Gokart, Metaflow, Kedro, PipelineX.
☆56Updated 4 years ago
Alternatives and similar repositories for Python_Packages_for_Pipeline_Workflow:
Users that are interested in Python_Packages_for_Pipeline_Workflow are comparing it to the libraries listed below
- Automatically export Jupyter notebooks to various file formats (.py, .html, and more) on save.☆75Updated 11 months ago
- The easiest way to integrate Kedro and Great Expectations☆53Updated 2 years ago
- ☆43Updated 2 years ago
- Tries to shrink your Pandas column dtypes with no data loss so you have more spare RAM☆83Updated last year
- Dockerized ML Cookiecutter☆71Updated last year
- Automated Exploratory Data Analysis. Simplifying Data Exploration☆34Updated 4 years ago
- PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more☆226Updated last year
- A package for data science practitioners. This library implements a number of helpful, common data transformations with a scikit-learn fr…☆55Updated 3 years ago
- A scikit-learn compatible estimator based on business-rules with interactive dashboard included☆28Updated 3 years ago
- A small python library that can clump lists of data together.☆147Updated 3 years ago
- 🍦 Deployment tool for online machine learning models☆97Updated 2 years ago
- A bit of extra usability for sqlalchemy v2.☆77Updated 7 months ago
- Automated Data Science and Machine Learning library to optimize workflow.☆104Updated last year
- A flexible template for doing reproducible data science in Python.☆110Updated 8 months ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆113Updated 9 months ago
- 🐍 Material for PyData Global 2021 Presentation: Effective Testing for Machine Learning Projects☆81Updated 3 years ago
- A CD4ML Example Setup on AWS S3, GitLab with DVC☆24Updated 2 years ago
- Decorators that logs stats.☆107Updated last year
- vtreat is a data frame processor/conditioner that prepares real-world data for predictive modeling in a statistically sound manner. Distr…☆121Updated last week
- SciKIt-learn Pipeline in PAndas☆42Updated last year
- A library for recording and reading data in notebooks.☆285Updated 2 years ago
- Summarise and explore Pandas DataFrames☆99Updated 4 years ago
- Viewer for Altair and Vega-Lite visualizations☆81Updated 9 months ago
- A plugin for Flake8 that checks pandas code☆168Updated last year
- An abstraction layer for parameter tuning☆36Updated 4 months ago
- JupyterHub extension for ContainDS Dashboards☆202Updated 5 months ago
- A GitHub action to build data science environment images with repo2docker and push them to registries.☆143Updated 2 months ago
- Visualization ideas for data science☆19Updated 6 years ago