Alternatives and similar repositories for luigiext-gcloud

Users that are interested in luigiext-gcloud are comparing it to the libraries listed below

• GoogleCloudPlatform / DataflowPythonSDK
  Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
  ☆163Updated 8 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 8 years ago
• iconara / bigshift
  A tool for moving tables from Redshift to BigQuery
  ☆65Updated 6 years ago
• miku / gluish
  Utils around luigi.
  ☆66Updated 4 years ago
• GoogleCloudPlatform / Data-Pipeline
  Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs…
  ☆87Updated 11 years ago
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 7 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 10 years ago
• Dwolla / arbalest
  Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…
  ☆41Updated 9 years ago
• sigmoidanalytics / spark_gce
  Spark GCE Script Helps you deploy Spark cluster on Google Cloud.
  ☆43Updated 10 years ago
• GoogleCloudPlatform / processing-logs-using-dataflow
  Processing Logs at Scale using Cloud Dataflow
  ☆61Updated 6 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 6 years ago
• monetate / s3nb
  S3-backed notebook manager for IPython
  ☆29Updated 8 years ago
• googlecodelabs / cloud-dataflow-nyc-taxi-tycoon
  This is the support code and solutions for the NYC Taxi Tycoon Dataflow Codelab
  ☆61Updated 5 years ago
• GoogleCloudPlatform / cloud-pubsub-samples-python
  Cloud Pub/Sub sample applications with Python
  ☆72Updated 8 years ago
• treasure-data / luigi-td
  Luigi Workflow Engine integration for Treasure Data
  ☆16Updated 7 years ago
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆58Updated 4 years ago
• egen / case_routing
  ☆31Updated last month
• snowplow-archive / google-cloud-dataflow-example-project
  Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow
  ☆30Updated 8 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• rwalk / straw
  A platform for real-time streaming search
  ☆102Updated 9 years ago
• GoogleCloudPlatform / dataflow-prediction-example
  ☆84Updated 6 years ago
• amplab / ampcrowd
  A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.
  ☆51Updated 8 years ago
• GoogleCloudPlatform / bigquery-reverse-geolocation
  ☆44Updated 9 years ago
• laserson / dsq
  Distributed Streaming Quantiles (for PySpark)
  ☆38Updated 11 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 10 years ago
• untoldone / bloomapi
  Create APIs out of public datasources
  ☆89Updated 7 years ago
• GoogleCloudPlatform / spark-examples
  Spark pipelines that correspond to a series of Dataflow examples.
  ☆27Updated 6 years ago
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 5 years ago
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆136Updated 3 years ago