segmentio / terraform-segment-data-lakes
Terraform modules which create AWS resources for a Segment Data Lake.
☆37Updated 4 months ago
Alternatives and similar repositories for terraform-segment-data-lakes:
Users that are interested in terraform-segment-data-lakes are comparing it to the libraries listed below
- Provider for AWS Redshift entities, eg Users, Groups, Permissions, Schemas, Databases☆47Updated 3 years ago
- Terraform module to create AWS Redshift resources 🇺🇦☆87Updated 3 weeks ago
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆20Updated 6 months ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- ☆73Updated 10 months ago
- Command-line app for tracking Snowplow events. Add analytics to your shell scripts and terminal sessions☆9Updated last year
- Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the…☆243Updated last month
- pg2kinesis uses logical decoding in Postgres 9.4 or later to capture a consistent, continuous stream of events from the database and publ…☆59Updated 2 years ago
- Presto-like CLI tool for AWS Athena☆84Updated 2 years ago
- Utility to create AWS Step Function activities out of command line programs☆16Updated this week
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated last year
- Web UI for Amazon Athena☆56Updated 2 years ago
- A fully-featured AWS Athena database driver (+ athenareader https://github.com/uber/athenadriver/tree/master/athenareader)☆159Updated 3 months ago
- Shoprunner Terraform provider - Open Source initiative☆37Updated 5 years ago
- A CLI and library to run Singer Taps and Targets☆34Updated 3 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis Data Streams on AWS Fargate☆37Updated last week
- CLENCLI enables you to quickly and predictably create, change, and improve your cloud projects. It is an open source tool that simplifies…☆59Updated 2 years ago
- Bring AWS SSO-based credentials to the AWS SDKs until they have proper support☆47Updated 4 years ago
- ☆22Updated 4 years ago
- Glue scripts for converting AWS Service Logs for use in Athena☆141Updated last year
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 7 months ago
- Friendly CLI for Amazon Kinesis Data Streams☆57Updated 4 years ago
- Reference Architectures for Datalakes on AWS☆79Updated 4 years ago
- 🌉 Reference implementation for granting cross-account AWS Glue Data Catalog access from Amazon Athena☆30Updated 2 years ago
- kinesis-kafka-connector is connector based on Kafka Connect to publish messages to Amazon Kinesis streams or Amazon Kinesis Firehose.☆155Updated last year
- Bring your own data Labs: Build a serverless data pipeline based on your own data☆44Updated last year
- Data Pipeline for CDC data from MySQL DB to Amazon OpenSearch Service through Amazon Kinesis using Amazon Data Migration Service(DMS).☆32Updated 3 months ago
- Library and worker to handle transfer of data in s3 into redshift. Includes table creation and manipulation, as well as time-based insert…☆61Updated 2 years ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated 2 years ago