snowplow / dataflow-runner
Run templatable playbooks of Hadoop/Spark/et al jobs on Amazon EMR
☆19Updated last year
Alternatives and similar repositories for dataflow-runner
Users that are interested in dataflow-runner are comparing it to the libraries listed below
Sorting:
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated 2 years ago
- Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.☆21Updated 6 months ago
- Unix tee, but for Kinesis streams☆12Updated 3 years ago
- ⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.☆41Updated 4 months ago
- Loads Snowplow enriched events from S3 into Snowflake☆11Updated last year
- Library and worker to handle transfer of data in s3 into redshift. Includes table creation and manipulation, as well as time-based insert…☆61Updated 2 years ago
- Command-line app for tracking Snowplow events. Add analytics to your shell scripts and terminal sessions☆9Updated last year
- Deploy Presto on the cloud easily, using Terraform and Packer☆45Updated 2 years ago
- A CLI and Go client for Kafka Schema Registry. This repository is deprecated and no longer maintained.☆114Updated 4 years ago
- Stores Snowplow enriched events in Redshift, Snowflake and Databricks☆31Updated last month
- Tools for working with parquet, impala, and hive☆134Updated 4 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- ☆21Updated 2 years ago
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 8 months ago
- A Kafka-Connect Sink for S3 with no Hadoop dependencies.☆57Updated 2 years ago
- Collector for cloud-native web, mobile and event analytics, running on AWS and GCP☆31Updated last month
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 4 years ago
- SQL data model for working with Snowplow web data. Supports Redshift and Looker. Snowflake and BigQuery coming soon☆60Updated 4 years ago
- A CLI and library to run Singer Taps and Targets☆34Updated 3 years ago
- tap-postgres☆68Updated 8 months ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆111Updated 5 years ago
- Load testing for event analytics platforms (Snowplow, more coming soon)☆13Updated 8 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Opinionated serverless event analytics pipeline☆43Updated 2 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆47Updated last year
- ☆42Updated 2 years ago
- Scala client for MaxMind Geo-IP☆86Updated last year
- Cubes over ElasticSearch. Aggregation library for Business Intelligence☆20Updated 10 years ago
- Data models for snowplow analytics.☆128Updated 3 months ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago