Alternatives and similar repositories for luigiext-gcloud:

Users that are interested in luigiext-gcloud are comparing it to the libraries listed below

• GoogleCloudPlatform / DataflowPythonSDK
  Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
  ☆163Updated 7 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆35Updated 8 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 6 years ago
• miku / gluish
  Utils around luigi.
  ☆65Updated 3 years ago
• iconara / bigshift
  A tool for moving tables from Redshift to BigQuery
  ☆65Updated 5 years ago
• treasure-data / luigi-td
  Luigi Workflow Engine integration for Treasure Data
  ☆16Updated 6 years ago
• GoogleCloudPlatform / Data-Pipeline
  Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs…
  ☆88Updated 10 years ago
• GoogleCloudPlatform / processing-logs-using-dataflow
  Processing Logs at Scale using Cloud Dataflow
  ☆61Updated 5 years ago
• GoogleCloudPlatform / appengine-pipelines
  makeViewerUrl
  ☆86Updated 7 months ago
• googlecodelabs / cloud-dataflow-nyc-taxi-tycoon
  This is the support code and solutions for the NYC Taxi Tycoon Dataflow Codelab
  ☆60Updated 5 years ago
• GoogleCloudPlatform / cloud-pubsub-samples-python
  Cloud Pub/Sub sample applications with Python
  ☆72Updated 8 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆103Updated 8 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 6 years ago
• snowplow-archive / google-cloud-dataflow-example-project
  Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow
  ☆30Updated 7 years ago
• GoogleCloudDataproc / bdutil
  [DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine
  ☆110Updated 5 years ago
• monetate / s3nb
  S3-backed notebook manager for IPython
  ☆29Updated 7 years ago
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆57Updated 3 years ago
• yu-iskw / bigquery-to-datastore
  Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow
  ☆58Updated 4 years ago
• egen / case_routing
  ☆31Updated 4 years ago
• GoogleCloudPlatform / cloud-pubsub-logging-python
  Small python logging handlers that directly send the logs to Cloud Pub/Sub
  ☆23Updated 4 years ago
• GoogleCloudPlatform / kubernetes-bigquery-python
  Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub
  ☆129Updated 4 years ago
• Lab41 / ipython-spark-docker
  ☆146Updated 8 years ago
• mhausenblas / usn-app
  UberSocialNet—applying the Lambda Architecture
  ☆29Updated 11 years ago
• treasure-data / luigi-td-example
  Example Repository for Building Complex Data Pipeline with Luigi +TD
  ☆24Updated 9 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 5 years ago
• amplab / ampcrowd
  A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.
  ☆51Updated 7 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 9 years ago