Alternatives and similar repositories for fairflow:

Users that are interested in fairflow are comparing it to the libraries listed below

• nteract / coffee_boat
  ☕⛵WIP PySpark dependency management
  ☆22Updated 6 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 6 years ago
• stitchfix / s3drive
  S3 backed ContentsManager for jupyter notebooks
  ☆13Updated 9 years ago
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆52Updated 6 years ago
• jupyter-incubator / proposals
  Proposals for new Jupyter subprojects to enter into incubation
  ☆18Updated 4 years ago
• quiltdata / t4
  T4 is now in production as Quilt 3
  ☆64Updated 5 years ago
• joerg-schneider / airtunnel
  The sane way of building a data layer in Airflow
  ☆24Updated 5 years ago
• tkp-archive / knowledgelab
  KnowledgeRepo + JupyterLab
  ☆48Updated 4 months ago
• tubular / sparkly
  Helpers & syntactic sugar for PySpark.
  ☆61Updated last year
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 5 years ago
• kyocum / disdat
  Data science tool for creating and deploying pipelines with versioned data
  ☆45Updated 8 months ago
• dask / dask-gke
  kubernetes setup to bootstrap distributed on google container engine
  ☆67Updated 5 years ago
• paypal / PPExtensions
  Set of iPython and Jupyter extensions to improve user experience
  ☆50Updated 5 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 6 years ago
• bonzanini / luigi-slack
  Slack notifications for the Luigi workflow manager
  ☆46Updated 3 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• spark-ml / mllib-grid-search
  An example project for doing grid search in MLlib
  ☆13Updated 10 years ago
• blue-yonder / postgraas_server
  Postgraas is a super simple PostgreSQL-as-a-service
  ☆29Updated 4 years ago
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆69Updated last year
• jamespic / pyspark-flame
  A low-overhead sampling profiler for PySpark, that outputs Flame Graphs
  ☆16Updated 4 years ago
• rsn491 / koopera
  Collaboration app for sharing and reviewing jupyter notebooks
  ☆16Updated last year
• Flowminder / pytest-airflow
  pytest support for airflow
  ☆12Updated 3 years ago
• SayreBlades / dask-ecs
  An opinionated template for spinning up a dask cluster based on docker.
  ☆14Updated 7 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• jcrist / hadoop-test-cluster
  Dockerized setup for testing code on realistic hadoop clusters
  ☆27Updated 4 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 6 years ago
• allenai / pipeline
  Library for building reproducible data pipelines to support experimentation
  ☆20Updated 9 years ago
• blaze / datafabric
  A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.
  ☆13Updated 9 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 5 years ago
• KonstantinosX / graphgen-project
  A Python wrapper over the GraphGen system
  ☆37Updated 7 years ago