Alternatives and similar repositories for dataflow-runner

Users that are interested in dataflow-runner are comparing it to the libraries listed below

• snowplow / sql-runner
  Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake
  ☆81Updated 5 months ago
• snowplow-archive / kinesis-tee
  Unix tee, but for Kinesis streams
  ☆12Updated 4 years ago
• snowplow / snowplow-scala-analytics-sdk
  Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.
  ☆21Updated last year
• snowplow-archive / snowplow-snowflake-loader
  Loads Snowplow enriched events from S3 into Snowflake
  ☆11Updated 2 years ago
• lensesio / schema-registry
  A CLI and Go client for Kafka Schema Registry. This repository is deprecated and no longer maintained.
  ☆113Updated 4 years ago
• snowplow / data-models
  ⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.
  ☆42Updated 10 months ago
• snowplow-archive / avalanche
  Load testing for event analytics platforms (Snowplow, more coming soon)
  ☆13Updated 9 years ago
• snowplow / iglu-central
  Contains all JSON Schemas, Avros and Thrifts for Iglu Central
  ☆122Updated 3 weeks ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• wix-incubator / kafka-connect-s3
  A Kafka-Connect Sink for S3 with no Hadoop dependencies.
  ☆57Updated 2 years ago
• snowplow / iglu
  Iglu is a machine-readable, open-source schema repository for JSON Schema from the team at Snowplow
  ☆213Updated last week
• graveyard / s3-to-redshift
  Library and worker to handle transfer of data in s3 into redshift. Includes table creation and manipulation, as well as time-based insert…
  ☆60Updated 2 years ago
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆68Updated 2 years ago
• snowplow / snowplow-mini
  An easily-deployable, single-instance version of Snowplow
  ☆128Updated last month
• BigDataBoutique / presto-cloud-deploy
  Deploy Presto on the cloud easily, using Terraform and Packer
  ☆45Updated 2 years ago
• spotify / dbeam
  DBeam exports SQL tables into Avro files using JDBC and Apache Beam
  ☆194Updated 2 weeks ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆82Updated 3 years ago
• snowplow / snowplow-s3-loader
  Mirrors a Kinesis stream to Amazon S3 using the KCL
  ☆42Updated 4 months ago
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆113Updated 5 years ago
• datamill-co / singer-runner
  A CLI and library to run Singer Taps and Targets
  ☆34Updated 3 years ago
• packetloop / terraform-provider-kafka
  Terraform provider for kafka
  ☆32Updated 5 years ago
• snowplow / snowplow-rdb-loader
  Stores Snowplow enriched events in Redshift, Snowflake and Databricks
  ☆30Updated 7 months ago
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆134Updated 3 years ago
• snowplow / snowplow-micro
  Standalone application to automate testing of trackers
  ☆51Updated last week
• schema-repo / schema-repo
  The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.
  ☆154Updated 3 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• marianogappa / flowbro
  Real-time flowchart visualisation for Kafka-based distributed systems.
  ☆120Updated 8 years ago
• stripe-archive / sequins
  A key/value store for serving static batch data
  ☆174Updated 2 years ago