Alternatives and similar repositories for awesome-pipeline:

Users that are interested in awesome-pipeline are comparing it to the libraries listed below

• pawl / awesome-etl
  A curated list of awesome ETL frameworks, libraries, and software.
  ☆3,390Updated 9 months ago
• common-workflow-language / common-workflow-language
  Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊
  ☆1,463Updated 4 months ago
• dask / dask
  Parallel computing with task scheduling
  ☆13,136Updated last week
• airbnb / knowledge-repo
  A next-generation curated knowledge sharing platform for data scientists and other technical professions.
  ☆5,513Updated 7 months ago
• mara / mara-pipelines
  A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
  ☆2,080Updated last year
• pachyderm / pachyderm
  Data-Centric Pipelines and Data Versioning
  ☆6,222Updated 2 months ago
• modin-project / modin
  Modin: Scale your Pandas workflows by changing a single line of code
  ☆10,116Updated last week
• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,234Updated 2 months ago
• jghoman / awesome-apache-airflow
  Curated list of resources about Apache Airflow
  ☆3,770Updated 8 months ago
• ibis-project / ibis
  the portable Python dataframe library
  ☆5,705Updated this week
• manuzhang / awesome-streaming
  a curated list of awesome streaming frameworks, applications, etc
  ☆2,801Updated last month
• nteract / papermill
  📚 Parameterize, execute, and analyze notebooks
  ☆6,137Updated 2 weeks ago
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆8,742Updated this week
• vaexio / vaex
  Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…
  ☆8,371Updated 6 months ago
• python-bonobo / bonobo
  Extract Transform Load for Python 3.5+
  ☆1,590Updated last year
• blaze / blaze
  NumPy and Pandas interface to Big Data
  ☆3,199Updated last year
• mwouts / jupytext
  Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts
  ☆6,814Updated this week
• markusschanta / awesome-jupyter
  A curated list of awesome Jupyter projects, libraries and resources
  ☆4,209Updated this week
• meirwah / awesome-workflow-engines
  A curated list of awesome open source workflow engines
  ☆6,987Updated 3 months ago
• wesm / feather
  Feather: fast, interoperable binary data frame storage for Python, R, and more powered by Apache Arrow
  ☆2,744Updated 3 years ago
• puckel / docker-airflow
  Docker Apache Airflow
  ☆3,803Updated 2 years ago
• SeldonIO / seldon-core
  An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
  ☆4,503Updated this week
• iterative / dvc
  🦉 Data Versioning and ML Experiments
  ☆14,402Updated this week
• dbt-labs / dbt-core
  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…
  ☆10,685Updated this week
• DataBiosphere / toil
  A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
  ☆909Updated this week
• amundsen-io / amundsen
  Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…
  ☆4,557Updated 3 weeks ago
• flyteorg / flyte
  Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
  ☆6,183Updated this week
• feast-dev / feast
  The Open Source Feature Store for AI/ML
  ☆5,975Updated this week
• mahmoud / boltons
  🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…
  ☆6,601Updated 2 months ago
• pytoolz / toolz
  A functional standard library for Python.
  ☆4,839Updated 3 months ago