rewindio / aws-athena-partition-autoloader
Automatically loads new partitions in AWS Athena
☆18Updated 4 years ago
Alternatives and similar repositories for aws-athena-partition-autoloader:
Users that are interested in aws-athena-partition-autoloader are comparing it to the libraries listed below
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆19Updated 4 years ago
- Sample Apache Beam pipeline that can be deployed to Amazon Managed Service for Apache Flink. It reads taxi events from a Kinesis data str…☆47Updated last year
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Unix tee, but for Kinesis streams☆12Updated 3 years ago
- minio as local storage and DynamoDB as catalog☆13Updated 10 months ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated last year
- A CLI to manage and monitor permissions in AWS Lake Formation☆27Updated 2 years ago
- Amazon EMR on EKS Custom Image CLI☆30Updated 6 months ago
- Amundsen Gremlin☆21Updated 2 years ago
- Herd-UI is a search and discovery tool for business and technical users. Everyone in your organization can use Herd-UI to browse and unde…☆16Updated 2 years ago
- Web UI for Amazon Athena☆56Updated 2 years ago
- Content for the Athena Guide (https://athena.guide)☆10Updated 5 months ago
- ☆53Updated last year
- Spark Scala docker container sample for AWS testing - EKS & S3☆24Updated 6 years ago
- Hive Storage Handler for Kinesis.☆11Updated 9 years ago
- ☆22Updated 4 years ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated last week
- Uses EMR clusters to export dynamoDB tables to S3 and generates import steps☆11Updated 2 years ago
- ☆23Updated 6 months ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆34Updated last month
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆13Updated last year
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆47Updated last year
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆44Updated 2 years ago
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆20Updated 5 months ago
- ☆24Updated last year
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆50Updated last year
- ☆13Updated 8 months ago