Alternatives and similar repositories for s3-concat

Users that are interested in s3-concat are comparing it to the libraries listed below

• whitfin / s3-utils
  Utilities and tools based around Amazon S3 to provide convenience APIs in a CLI
  ☆57Updated 4 years ago
• snowplow / sql-runner
  Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake
  ☆81Updated 6 months ago
• foursquare / quiver
  An HFile-backed Key-Value Server
  ☆43Updated 6 years ago
• vpon / protobuf-to-avro
  dynamically parse protobuf message then convert to avro
  ☆25Updated 10 years ago
• snowplow-archive / icebucket
  UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage
  ☆14Updated 10 years ago
• jwplayer / southpaw
  Streaming left joins in Kafka for change data capture
  ☆52Updated last year
• andrewgross / json2parquet
  Convert JSON files to Parquet using PyArrow
  ☆97Updated last year
• libin / s3distcp
  ☆20Updated 4 years ago
• AdRoll / cantor
  Cantor provides utilities for estimating the cardinality of large sets.
  ☆84Updated 3 years ago
• sailthru / stolos
  A Directed Acyclic Graph task dependency scheduler designed to simplify complex distributed pipelines
  ☆132Updated 7 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 9 years ago
• gaul / are-we-consistent-yet
  Compare eventual consistency of object stores
  ☆176Updated last year
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆27Updated 3 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated 2 years ago
• snowplow / factotum
  A system to programmatically run data pipelines
  ☆225Updated last month
• yodasco / pyspark-emr
  A toolset to streamline running spark python on EMR
  ☆20Updated 9 years ago
• steveloughran / zero-rename-committer
  Paper: A Zero-rename committer for object stores
  ☆20Updated last month
• whitfin / s3-meta
  Gather metadata about your S3 buckets
  ☆49Updated 4 years ago
• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆88Updated 4 years ago
• cloudfuse-io / buzz-rust
  Serverless query engine
  ☆141Updated 2 years ago
• stripe-archive / timberlake
  Timberlake is a Job Tracker for Hadoop.
  ☆177Updated 5 years ago
• jpzk / twitterstream
  Twitter Streaming API Example with Kafka Streams in Scala
  ☆49Updated 9 years ago
• yu-iskw / spark-dataframe-introduction
  This is an introduction of Apache Spark DataFrames.
  ☆41Updated 10 years ago
• memsql / streamliner-examples
  Example code for building your own MemSQL Streamliner Pipelines
  ☆23Updated 8 years ago
• posix4e / jsoncdc
  JSONCDC is now maintained at,
  ☆90Updated 7 years ago
• rdblue / parquet-cli
  Parquet Command-line Tools
  ☆19Updated 9 years ago
• AnderEnder / s3find-rs
  Walk an Amazon s3 path hierarchy
  ☆36Updated last week
• mozilla / jsonschema-transpiler
  Compile JSON Schema into Avro and BigQuery schemas
  ☆45Updated last year
• snowplow-archive / schema-guru
  JSONs -> JSON Schema
  ☆153Updated 5 years ago
• fede1024 / kafka-benchmark
  A tool to run benchmarks on Kafka clusters
  ☆100Updated 2 years ago