Alternatives and similar repositories for fairflow

Users that are interested in fairflow are comparing it to the libraries listed below

• quiltdata / t4
  T4 is now in production as Quilt 3
  ☆64Updated 6 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 7 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated 2 years ago
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆53Updated 7 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 6 years ago
• infOpen / ansible-role-airflow
  Ansible role to deploy and configure Airflow
  ☆41Updated last week
• tubular / sparkly
  Helpers & syntactic sugar for PySpark.
  ☆62Updated 2 years ago
• kyocum / disdat
  Data science tool for creating and deploying pipelines with versioned data
  ☆45Updated last month
• paypal / PPExtensions
  Set of iPython and Jupyter extensions to improve user experience
  ☆50Updated 6 years ago
• nteract / coffee_boat
  ☕⛵WIP PySpark dependency management
  ☆22Updated 7 years ago
• stitchfix / s3drive
  S3 backed ContentsManager for jupyter notebooks
  ☆14Updated 9 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 7 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 9 years ago
• SayreBlades / dask-ecs
  An opinionated template for spinning up a dask cluster based on docker.
  ☆14Updated 8 years ago
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆68Updated 2 years ago
• joerg-schneider / airtunnel
  The sane way of building a data layer in Airflow
  ☆24Updated 5 years ago
• nteract / bookstore
  📚 Notebook storage and publishing workflows for the masses
  ☆201Updated 4 years ago
• blaze / datafabric
  A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.
  ☆13Updated 9 years ago
• peopledoc / mlvtools
  Public repository for versioning machine learning data
  ☆42Updated 4 years ago
• tcarette / vim-sparkShell
  control spark-shell from vim
  ☆11Updated 9 years ago
• dask / dask-gke
  kubernetes setup to bootstrap distributed on google container engine
  ☆67Updated 6 years ago
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 6 years ago
• mara / mara-etl-tools
  Utilities for creating ETL pipelines with mara
  ☆36Updated 3 years ago
• tkp-archive / knowledgelab
  KnowledgeRepo + JupyterLab
  ☆48Updated last week
• andrewgross / json2parquet
  Convert JSON files to Parquet using PyArrow
  ☆97Updated last year
• kayak / fireant
  Data analysis and reporting tool for quick access to custom charts and tables in Jupyter Notebooks and in the shell.
  ☆123Updated last year
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 4 years ago
• dask / dask-ec2
  Start a cluster in EC2 for dask.distributed
  ☆106Updated 5 years ago
• spiside / docker-luigi
  A project to help develop Luigi pipelines using Docker ✳️
  ☆80Updated 4 years ago
• quiltdata / examples
  ☆12Updated last month