Alternatives and similar repositories for luigiext-gcloud

Users that are interested in luigiext-gcloud are comparing it to the libraries listed below

• GoogleCloudPlatform / DataflowPythonSDK
  Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
  ☆164Updated 8 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 9 years ago
• GoogleCloudPlatform / cloud-pubsub-samples-python
  Cloud Pub/Sub sample applications with Python
  ☆72Updated 9 years ago
• miku / gluish
  Utils around luigi.
  ☆66Updated 3 weeks ago
• iconara / bigshift
  A tool for moving tables from Redshift to BigQuery
  ☆65Updated 6 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 8 years ago
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 7 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆102Updated 9 years ago
• GoogleCloudPlatform / kubernetes-bigquery-python
  Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub
  ☆129Updated 4 years ago
• GoogleCloudPlatform / Data-Pipeline
  Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs…
  ☆87Updated 11 years ago
• alexvanboxel / airflow-gcp-examples
  Repository with examples and smoke tests for the GCP Airflow operators and hooks
  ☆149Updated 8 years ago
• Lab41 / ipython-spark-docker
  ☆146Updated 9 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 6 years ago
• Yelp / mycroft
  ☆42Updated 3 years ago
• GoogleCloudPlatform / processing-logs-using-dataflow
  Processing Logs at Scale using Cloud Dataflow
  ☆61Updated 6 years ago
• GoogleCloudPlatform / appengine-pipelines
  makeViewerUrl
  ☆90Updated last year
• coursera / dataduct
  DataPipeline for humans.
  ☆249Updated 3 years ago
• egen / case_routing
  ☆31Updated 4 months ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 10 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• gotitinc / mongo-bigquery
  Load your MongoDB collection into Google BigQuery. Supports complex JSON structure.
  ☆28Updated 8 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 6 years ago
• GoogleCloudPlatform / cloud-pubsub-logging-python
  Small python logging handlers that directly send the logs to Cloud Pub/Sub
  ☆23Updated 5 years ago
• amplab / ampcrowd
  A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.
  ☆52Updated 8 years ago
• snowplow-archive / google-cloud-dataflow-example-project
  Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow
  ☆30Updated 8 years ago
• Dwolla / arbalest
  Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…
  ☆41Updated 9 years ago
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆136Updated 3 years ago
• googlecodelabs / cloud-dataflow-nyc-taxi-tycoon
  This is the support code and solutions for the NYC Taxi Tycoon Dataflow Codelab
  ☆62Updated 5 years ago
• GoogleCloudDataproc / bdutil
  [DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine
  ☆109Updated 5 years ago
• traildb / traildb-python
  Python bindings for TrailDB
  ☆38Updated 5 years ago