SimpleFinance / pipewelder
Scheduled task execution on top of AWS Data Pipeline
☆43Updated 10 years ago
Alternatives and similar repositories for pipewelder:
Users that are interested in pipewelder are comparing it to the libraries listed below
- Redshift Ops Console☆92Updated 9 years ago
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…☆41Updated 9 years ago
- JSON -> Relational DB Column Types☆63Updated 2 years ago
- Postgres pg_dump -> Redshift☆34Updated 10 years ago
- Luigi Plugin for Hubot☆35Updated 8 years ago
- Utils around luigi.☆65Updated 4 years ago
- Amazon Redshift SQLAlchemy Dialect☆48Updated 9 years ago
- Copy data from a postgres db into redshift☆82Updated 6 years ago
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 6 years ago
- DonorsChoose.org Data Science Team Opensource Code☆77Updated 2 years ago
- ☆42Updated 2 years ago
- Empower Curiosity / Redshift analytics platform☆77Updated 3 years ago
- Spotify's Luigi + Amazon's SWF integration☆16Updated 9 years ago
- Timberlake is a Job Tracker for Hadoop.☆177Updated 5 years ago
- Python bindings for TrailDB☆39Updated 5 years ago
- ☆54Updated 7 years ago
- SQL for many helpful Redshift UDFs, and the scripts for generating and testing those UDFs☆125Updated 6 years ago
- DataPipeline for humans.☆251Updated 2 years ago
- Tools for working with parquet, impala, and hive☆134Updated 4 years ago
- S3 backed ContentsManager for jupyter notebooks☆13Updated 9 years ago
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated last year
- A tool for moving tables from Redshift to BigQuery☆65Updated 6 years ago
- Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker☆253Updated 9 years ago
- An example function showing how to count events from s3 in dynamo using lambda☆78Updated 9 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- Python SDK for working with Snowplow enriched events in Spark, AWS Lambda et al.☆21Updated 3 months ago
- A Python library for dealing with splittable files☆42Updated 5 years ago
- Automated creation and management of AWS CloudWatch Metric Alarms☆37Updated last year
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago