ExpediaGroup / apiaryLinks
Apiary provides modules which can be combined to create a federated cloud data lake
☆36Updated last year
Alternatives and similar repositories for apiary
Users that are interested in apiary are comparing it to the libraries listed below
Sorting:
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- Stream Discovery and Stream Orchestration☆122Updated 6 months ago
- Graph Analytics with Apache Kafka☆104Updated 2 weeks ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆61Updated 8 months ago
- Service for automatically managing and cleaning up unreferenced data☆46Updated last week
- ☆80Updated 3 months ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆222Updated 4 months ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆51Updated last month
- ☆62Updated 6 years ago
- Mirus is a cross data-center data replication tool for Apache Kafka☆205Updated last month
- Performance optimization for Spark running on Kubernetes☆89Updated 4 years ago
- Multi-hop declarative data pipelines☆117Updated this week
- A library for Spark DataFrame using MinIO Select API☆98Updated 5 years ago
- Quark is a data virtualization engine over analytic databases.☆98Updated 8 years ago
- Open Source Secret Provider plugin for the Kafka Connect framework☆47Updated last year
- Dione - a Spark and HDFS indexing library☆52Updated last year
- kinesis-kafka-connector is connector based on Kafka Connect to publish messages to Amazon Kinesis streams or Amazon Kinesis Firehose.☆155Updated last year
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 5 years ago
- Jupyter Integration for Flink SQL via Ververica Platform☆43Updated 2 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆97Updated 4 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆69Updated 5 months ago
- Amundsen Gremlin☆21Updated 2 years ago
- Apache Ranger Plugin for S3☆20Updated 2 years ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆45Updated 2 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆102Updated 2 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆60Updated 2 years ago
- Trino connectors for accessing APIs with an OpenAPI spec☆37Updated last month
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 3 years ago
- Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline☆75Updated 2 years ago