whitfin / s3-concatLinks
Concatenate Amazon S3 files remotely using flexible patterns
☆38Updated 4 years ago
Alternatives and similar repositories for s3-concat
Users that are interested in s3-concat are comparing it to the libraries listed below
Sorting:
- Gather metadata about your S3 buckets☆49Updated 4 years ago
- Streaming left joins in Kafka for change data capture☆52Updated 2 weeks ago
- An HFile-backed Key-Value Server☆43Updated 6 years ago
- A Directed Acyclic Graph task dependency scheduler designed to simplify complex distributed pipelines☆132Updated 7 years ago
- Cantor provides utilities for estimating the cardinality of large sets.☆84Updated 3 years ago
- Provides a Pythonic interface for reading and writing Avro schemas☆27Updated 3 years ago
- A system to programmatically run data pipelines☆226Updated 2 months ago
- UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage☆14Updated 10 years ago
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated 8 months ago
- logq - Analyzing log files in PartiQL with command-line toolkit, implemented in Rust☆46Updated 3 years ago
- Convert JSON files to Parquet using PyArrow☆98Updated 2 years ago
- dynamically parse protobuf message then convert to avro☆25Updated 10 years ago
- RDB parsing & dumping library and utility☆64Updated 9 months ago
- An apporximate frequency counter Redis module☆46Updated 6 years ago
- An analyzer for getting metrics about the contents of a Apache Kafka topic☆64Updated 4 years ago
- JSONCDC is now maintained at,☆90Updated 7 years ago
- t-digest module for Redis☆73Updated 5 years ago
- ☆19Updated 7 years ago
- Serverless query engine☆141Updated 3 years ago
- A key/value store for serving static batch data☆174Updated 2 years ago
- Walk an Amazon s3 path hierarchy☆36Updated this week
- spark-emr☆15Updated 11 years ago
- Tools for working with parquet, impala, and hive☆134Updated 5 years ago
- Library and worker to handle transfer of data in s3 into redshift. Includes table creation and manipulation, as well as time-based insert…☆60Updated 3 years ago
- Aerospike Spark Connector☆35Updated 8 years ago
- R(Rust) PG(Postgresql) FFI (Foreign Function Interface)☆83Updated 6 years ago
- Use SQL to transform your avro schema/records☆28Updated 8 years ago
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆88Updated 4 years ago
- Compare eventual consistency of object stores☆178Updated last year
- Copy tabular data between databases, CSV files and cloud storage☆240Updated last month