Houzz / hubot-luigi

Related projects: ⓘ

• miku / gluish
  Utils around luigi.
  ☆65Updated 3 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 9 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 5 years ago
• SimpleFinance / shiftmanager
  ☆56Updated this week
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆57Updated 3 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 5 years ago
• Dwolla / arbalest
  Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…
  ☆41Updated 8 years ago
• zalando-incubator / spark-appliance
  ☆37Updated this week
• treasure-data / luigi-td
  Luigi Workflow Engine integration for Treasure Data
  ☆16Updated 6 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• alexvanboxel / luigiext-gcloud
  *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…
  ☆42Updated 8 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated 11 months ago
• seatgeek / cronq
  ☆62Updated this week
• unnati-xyz / luigi-sample
  Sample repo for luigi tasks & config
  ☆36Updated 8 years ago
• seahboonsiew / pyspark-csv
  An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…
  ☆90Updated 8 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 6 years ago
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆53Updated 6 years ago
• amplab / ampcrowd
  A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.
  ☆51Updated 7 years ago
• wrobstory / malort
  JSON -> Relational DB Column Types
  ☆64Updated last year
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆46Updated 4 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆103Updated 8 years ago
• mortardata / mortar-examples
  ☆33Updated this week
• eleflow / sparknotebook
  A fast way of getting a Spark cluster up and running on AWS with the friendly IPython interface.
  ☆10Updated 9 years ago
• monetate / s3nb
  S3-backed notebook manager for IPython
  ☆29Updated 7 years ago
• binarymatt / redshift_sqlalchemy
  Amazon Redshift SQLAlchemy Dialect
  ☆48Updated 8 years ago
• heroku / heroku-airflow
  Demo of Author data workflows with Airflow on Heroku (not maintained)
  ☆23Updated 2 years ago
• Byhiras / pyavroc
  ☆49Updated this week
• stitchfix / s3drive
  S3 backed ContentsManager for jupyter notebooks
  ☆13Updated 8 years ago
• broxtronix / spark-gce
  A tool for running Spark on Google Compute Engine
  ☆17Updated 7 years ago