SayreBlades / dask-ecs

Related projects: ⓘ

• michaelosthege / fairflow
  Functional Airflow DAG definitions.
  ☆38Updated 7 years ago
• markfink / jupyter-athena-sql
  run SQL queries on AWS Athena from jupyter notebooks
  ☆19Updated 5 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 5 years ago
• spark-ml / mllib-grid-search
  An example project for doing grid search in MLlib
  ☆13Updated 9 years ago
• quiltdata / t4
  T4 is now in production as Quilt 3
  ☆64Updated 5 years ago
• CommBank / coppersmith
  ☆40Updated this week
• allenai / pipeline
  Library for building reproducible data pipelines to support experimentation
  ☆20Updated 8 years ago
• unruly / terraform-aws-airflow
  Terraform module for a PostgreSQL-backed Apache Airflow instance
  ☆24Updated 6 years ago
• malcolmgreaves / fp4ml
  A library of machine learning algorithms implemented using principles of functional programming.
  ☆22Updated 7 years ago
• capless / docb
  Opinionated Python ORM for DynamoDB
  ☆27Updated 5 years ago
• zalando-incubator / spark-appliance
  ☆37Updated this week
• memsql / pipelines-twitter-demo
  Example project which simulates an interesting analytics use case using MemSQL Pipelines.
  ☆14Updated 7 years ago
• mindfulmachines / peapod
  Dependency and data pipeline management framework for Spark and Scala
  ☆15Updated 7 years ago
• hammerlab / kubeface
  python parallel map on kubernetes
  ☆34Updated 7 years ago
• InMobi / docker-hive
  Docker image for Apache Hive running on Tez
  ☆7Updated 9 years ago
• snowplow / kinesis-example-scala-consumer
  Example Scala/SBT event consumer for Amazon Kinesis
  ☆22Updated 9 years ago
• opentrials / opentrials-airflow
  Configuration and definitions of Airflow for OpenTrials
  ☆18Updated 7 years ago
• snowplow / snowplow-s3-loader
  Mirrors a Kinesis stream to Amazon S3 using the KCL
  ☆42Updated 2 weeks ago
• treasure-data / luigi-td-example
  Example Repository for Building Complex Data Pipeline with Luigi +TD
  ☆24Updated 9 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 6 years ago
• nteract / coffee_boat
  ☕⛵WIP PySpark dependency management
  ☆22Updated 6 years ago
• jove-sh / jove-spark
  ☆10Updated this week
• mesosphere / dcos-spark
  ☆21Updated this week
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆53Updated 6 years ago
• wmlba / ECS-Dask
  Dask on ECS Fargate
  ☆14Updated 4 years ago
• bonzanini / luigi-slack
  Slack notifications for the Luigi workflow manager
  ☆46Updated 3 years ago
• python-bonobo / bonobo-docker
  PREVIEW - Run Bonobo data processing graphs in docker containers.
  ☆13Updated last year
• natbusa / anomaly-detection
  ☆27Updated this week
• awslabs / aws-iot-analytics-notebook-containers
  An extension for Jupyter notebooks that allows running notebooks inside a Docker container and converting them to runnable Docker images.
  ☆28Updated last year
• hakuch / TravellingAnts
  ☆41Updated this week