treasure-data / luigi-td-example
Example Repository for Building Complex Data Pipeline with Luigi +TD
☆24Updated 10 years ago
Alternatives and similar repositories for luigi-td-example:
Users that are interested in luigi-td-example are comparing it to the libraries listed below
- ☆54Updated 7 years ago
- Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow☆30Updated 8 years ago
- Luigi Workflow Engine integration for Treasure Data☆16Updated 6 years ago
- Luigi Plugin for Hubot☆36Updated 8 years ago
- Docker container to make running Luigi tasks real easy.☆11Updated 8 years ago
- Interactive data analysis with Pandas and Treasure Data.☆37Updated 5 years ago
- A luigi powered analytics / warehouse stack☆88Updated 8 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 8 months ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- Amazon Redshift SQLAlchemy Dialect☆48Updated 9 years ago
- A Singer.io Target for the Stitch Import API☆26Updated 3 months ago
- Example code for building your own MemSQL Streamliner Pipelines☆23Updated 8 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Snowplow event tracker for Python. Add analytics to your Python and Django apps, webapps and games☆44Updated 2 months ago
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24Updated 6 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 3 weeks ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Dockerfiles for dockerhub automated build.☆7Updated 6 years ago
- Generate BigQuery tables, load and extract data, based on JSON Table Schema descriptors.☆18Updated 3 years ago
- Shoprunner Terraform provider - Open Source initiative☆37Updated 5 years ago
- a declarative ETL framework that enforces data engineer best practices☆39Updated 7 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- Scheduled task execution on top of AWS Data Pipeline☆43Updated 10 years ago
- Slack notifications for the Luigi workflow manager☆46Updated 3 years ago
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- The Scalding tutorial as a standalone SBT project☆51Updated 7 years ago