Alternatives and similar repositories for s3drive

Users that are interested in s3drive are comparing it to the libraries listed below

• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆53Updated 7 years ago
• michaelosthege / fairflow
  Functional Airflow DAG definitions.
  ☆38Updated 8 years ago
• wrobstory / malort
  JSON -> Relational DB Column Types
  ☆63Updated 2 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 10 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 7 years ago
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 6 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 7 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 7 years ago
• monetate / s3nb
  S3-backed notebook manager for IPython
  ☆29Updated 8 years ago
• hammerlab / kubeface
  python parallel map on kubernetes
  ☆34Updated 8 years ago
• miku / gluish
  Utils around luigi.
  ☆66Updated 3 months ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 9 years ago
• stitchfix / splits
  A Python library for dealing with splittable files
  ☆42Updated 6 years ago
• EverythingMe / redshift_console
  Redshift Ops Console
  ☆92Updated 10 years ago
• seahboonsiew / pyspark-csv
  An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…
  ☆90Updated 10 years ago
• Dwolla / arbalest
  Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…
  ☆41Updated 9 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated 2 years ago
• getcarina / jupyterhub-tutorial
  Deploy an interactive data science environment with JupyterHub on Docker Swarm
  ☆21Updated 9 years ago
• redsymbol / csv2parquet
  Create Parquet files from CSV
  ☆70Updated 8 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 6 years ago
• DistrictDataLabs / cultivar
  Multidimensional data explorer and visualization tool.
  ☆56Updated 8 years ago
• unnati-xyz / luigi-sample
  Sample repo for luigi tasks & config
  ☆36Updated 9 years ago
• laserson / dsq
  Distributed Streaming Quantiles (for PySpark)
  ☆38Updated 11 years ago
• coursera / dataduct
  DataPipeline for humans.
  ☆250Updated 3 years ago
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 8 years ago
• danielballan / nbexamples
  distribute notebooks for users to copy via a web interface
  ☆69Updated 9 years ago
• compmodels / jupyterhub-deploy
  JupyterHub Playbook for the Computational Models class at Berkeley
  ☆82Updated 9 years ago
• quiltdata / t4
  T4 is now in production as Quilt 3
  ☆64Updated 6 years ago
• deanmalmgren / flo
  enable rapid iteration and development of complex data pipelines
  ☆29Updated 9 months ago