Alternatives and similar repositories for s3drive

Users that are interested in s3drive are comparing it to the libraries listed below

• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆52Updated 7 years ago
• wrobstory / malort
  JSON -> Relational DB Column Types
  ☆63Updated 2 years ago
• michaelosthege / fairflow
  Functional Airflow DAG definitions.
  ☆38Updated 8 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 10 years ago
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 6 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 6 years ago
• redsymbol / csv2parquet
  Create Parquet files from CSV
  ☆69Updated 8 years ago
• monetate / s3nb
  S3-backed notebook manager for IPython
  ☆29Updated 8 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 7 years ago
• miku / gluish
  Utils around luigi.
  ☆66Updated last month
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 9 years ago
• seahboonsiew / pyspark-csv
  An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…
  ☆90Updated 9 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 6 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 8 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 9 years ago
• stitchfix / flotilla-os
  Open source Flotilla
  ☆195Updated this week
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• DistrictDataLabs / cultivar
  Multidimensional data explorer and visualization tool.
  ☆56Updated 8 years ago
• unnati-xyz / luigi-sample
  Sample repo for luigi tasks & config
  ☆36Updated 9 years ago
• Dwolla / arbalest
  Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…
  ☆41Updated 9 years ago
• danielballan / nbexamples
  distribute notebooks for users to copy via a web interface
  ☆69Updated 8 years ago
• infOpen / ansible-role-airflow
  Ansible role to deploy and configure Airflow
  ☆41Updated 2 weeks ago
• compmodels / jupyterhub-deploy
  JupyterHub Playbook for the Computational Models class at Berkeley
  ☆82Updated 8 years ago
• dask / dask-ec2
  Start a cluster in EC2 for dask.distributed
  ☆106Updated 4 years ago
• mcolebrook / DSbox
  Data Science box: Spark, Jupyter, R+RStudio, Zeppelin, Python 2 & 3, Java, Scala.
  ☆39Updated 7 years ago
• laserson / dsq
  Distributed Streaming Quantiles (for PySpark)
  ☆38Updated 11 years ago
• hammerlab / kubeface
  python parallel map on kubernetes
  ☆34Updated 8 years ago
• martindurant / fastparquet
  python implementation of the parquet columnar file format.
  ☆21Updated last week
• laughingman7743 / PyAthenaJDBC
  PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).
  ☆95Updated 2 years ago