snowplow / dataflow-runnerLinks
Run templatable playbooks of Hadoop/Spark/et al jobs on Amazon EMR
☆19Updated last year
Alternatives and similar repositories for dataflow-runner
Users that are interested in dataflow-runner are comparing it to the libraries listed below
Sorting:
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated 2 months ago
- Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.☆21Updated 9 months ago
- Unix tee, but for Kinesis streams☆12Updated 3 years ago
- Tools for working with parquet, impala, and hive☆134Updated 4 years ago
- Load testing for event analytics platforms (Snowplow, more coming soon)☆13Updated 9 years ago
- Library and worker to handle transfer of data in s3 into redshift. Includes table creation and manipulation, as well as time-based insert…☆61Updated 2 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆94Updated 6 years ago
- Loads Snowplow enriched events from S3 into Snowflake☆11Updated last year
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 3 weeks ago
- A CLI and Go client for Kafka Schema Registry. This repository is deprecated and no longer maintained.☆114Updated 4 years ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆45Updated 2 years ago
- ⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.☆42Updated 7 months ago
- A Kafka-Connect Sink for S3 with no Hadoop dependencies.☆57Updated 2 years ago
- An easily-deployable, single-instance version of Snowplow☆129Updated last month
- Stores Snowplow enriched events in Redshift, Snowflake and Databricks☆31Updated 4 months ago
- Iglu is a machine-readable, open-source schema repository for JSON Schema from the team at Snowplow☆212Updated 2 weeks ago
- Docker images for Snowplow, Iglu and associated projects☆61Updated 4 years ago
- JSONs -> JSON Schema☆152Updated 4 years ago
- Terraform provider for kafka☆32Updated 5 years ago
- Snowplow Request Validator☆10Updated 8 years ago
- Ephemeral Hadoop clusters using Google Compute Platform☆136Updated 3 years ago
- UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage☆14Updated 9 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆73Updated 4 years ago
- A CLI and library to run Singer Taps and Targets☆34Updated 3 years ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated 2 years ago
- Contains all JSON Schemas, Avros and Thrifts for Iglu Central☆122Updated 2 weeks ago
- A key/value store for serving static batch data☆175Updated 2 years ago
- DBeam exports SQL tables into Avro files using JDBC and Apache Beam☆195Updated 2 weeks ago
- The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.☆155Updated 3 years ago
- Examples on how to use the command line tools in Avro Tools to read and write Avro files☆154Updated last year