whitfin / s3-concat
Concatenate Amazon S3 files remotely using flexible patterns
☆39Updated 3 years ago
Alternatives and similar repositories for s3-concat:
Users that are interested in s3-concat are comparing it to the libraries listed below
- Utilities and tools based around Amazon S3 to provide convenience APIs in a CLI☆53Updated 3 years ago
- Gather metadata about your S3 buckets☆48Updated 3 years ago
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 4 months ago
- Example code for building your own MemSQL Streamliner Pipelines☆23Updated 7 years ago
- Run templatable playbooks of Hadoop/Spark/et al jobs on Amazon EMR☆19Updated 9 months ago
- UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage☆14Updated 9 years ago
- Walk an Amazon s3 path hierarchy☆33Updated 3 weeks ago
- Compile JSON Schema into Avro and BigQuery schemas☆43Updated 11 months ago
- Collection of AWS Lambdas for creating and managing Delta tables☆24Updated this week
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated last year
- A library to work with CRDTs in rust☆16Updated last year
- An HFile-backed Key-Value Server☆42Updated 5 years ago
- Listen in on all the gossip going on in your kubernetes cluster☆12Updated 7 years ago
- Avro Schema Registry (mostly) compatible with salsify/avro-schema-registry☆17Updated this week
- Presto connector to Amazon Kinesis service.☆14Updated 5 years ago
- Kubernetes Dynamic Log Tailing Utility☆41Updated 6 years ago
- Guide for Creating an AWS Lambda Function using Rust☆22Updated last year
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- Apache Parquet implementation in Rust☆148Updated 6 years ago
- Robust data transformation tool using SQL☆20Updated 2 years ago
- Hotdog is a syslog-to-Kafka forwarder which aims to get log entries into Apache Kafka as quickly as possible.☆45Updated last year
- A cryptographically verifiable access control and directory system for Linux servers☆54Updated 7 years ago
- An apporximate frequency counter Redis module☆46Updated 5 years ago
- Library and worker to handle transfer of data in s3 into redshift. Includes table creation and manipulation, as well as time-based insert…☆61Updated 2 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 4 years ago
- Cantor provides utilities for estimating the cardinality of large sets.☆83Updated 2 years ago
- Usage examples for Divolte collector☆17Updated 7 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆46Updated last year