ExpediaGroup / apiaryLinks
Apiary provides modules which can be combined to create a federated cloud data lake
☆36Updated last year
Alternatives and similar repositories for apiary
Users that are interested in apiary are comparing it to the libraries listed below
Sorting:
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 3 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆51Updated this week
- Amundsen Gremlin☆21Updated 2 years ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆45Updated 2 years ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆20Updated 5 years ago
- ☆14Updated 2 weeks ago
- Service for automatically managing and cleaning up unreferenced data☆46Updated this week
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 5 years ago
- Open Source Secret Provider plugin for the Kafka Connect framework☆47Updated 11 months ago
- Performance optimization for Spark running on Kubernetes☆89Updated 4 years ago
- Dione - a Spark and HDFS indexing library☆52Updated last year
- Spark Scala docker container sample for AWS testing - EKS & S3☆24Updated 6 years ago
- Mutation testing framework and code coverage for Hive SQL☆24Updated 4 years ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Graph Analytics with Apache Kafka☆104Updated this week
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- Setup for running Trino with Hive Metastore on Kubernetes☆101Updated 2 years ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆29Updated this week
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆14Updated 2 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.☆43Updated last week
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆69Updated 4 months ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆45Updated 2 years ago
- Kafka Configuration Provider for AWS Secrets Manager☆23Updated 2 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 4 years ago