Alternatives and similar repositories for luigiext-gcloud:

Users that are interested in luigiext-gcloud are comparing it to the libraries listed below

• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• GoogleCloudPlatform / DataflowPythonSDK
  Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
  ☆163Updated 7 years ago
• miku / gluish
  Utils around luigi.
  ☆65Updated 4 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆35Updated 8 years ago
• GoogleCloudPlatform / Data-Pipeline
  Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs…
  ☆87Updated 11 years ago
• GoogleCloudPlatform / cloud-pubsub-samples-python
  Cloud Pub/Sub sample applications with Python
  ☆72Updated 8 years ago
• GoogleCloudDataproc / bdutil
  [DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine
  ☆109Updated 5 years ago
• alexvanboxel / airflow-gcp-examples
  Repository with examples and smoke tests for the GCP Airflow operators and hooks
  ☆147Updated 8 years ago
• GoogleCloudPlatform / processing-logs-using-dataflow
  Processing Logs at Scale using Cloud Dataflow
  ☆61Updated 6 years ago
• GoogleCloudPlatform / appengine-pipelines
  makeViewerUrl
  ☆87Updated 10 months ago
• iconara / bigshift
  A tool for moving tables from Redshift to BigQuery
  ☆65Updated 6 years ago
• snowplow-archive / google-cloud-dataflow-example-project
  Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow
  ☆30Updated 8 years ago
• googlecodelabs / cloud-dataflow-nyc-taxi-tycoon
  This is the support code and solutions for the NYC Taxi Tycoon Dataflow Codelab
  ☆60Updated 5 years ago
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 5 years ago
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 6 years ago
• GoogleCloudPlatform / dataflow-prediction-example
  ☆84Updated 6 years ago
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆58Updated 4 years ago
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆135Updated 3 years ago
• treasure-data / luigi-td
  Luigi Workflow Engine integration for Treasure Data
  ☆16Updated 6 years ago
• egen / case_routing
  ☆31Updated last week
• sigmoidanalytics / spark_gce
  Spark GCE Script Helps you deploy Spark cluster on Google Cloud.
  ☆43Updated 9 years ago
• GoogleCloudPlatform / kubernetes-bigquery-python
  Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub
  ☆129Updated 4 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 6 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆103Updated 9 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 10 years ago
• amplab / ampcrowd
  A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.
  ☆51Updated 7 years ago
• GoogleCloudPlatform / dataflow-opinion-analysis
  Opinion Analysis of News, Threaded Conversations, and User Generated Content
  ☆102Updated 6 months ago
• alexvanboxel / pubsub-backup
  ☆27Updated 6 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 5 years ago
• Lab41 / ipython-spark-docker
  ☆146Updated 9 years ago