ExpediaGroup / apiary
Apiary provides modules which can be combined to create a federated cloud data lake
☆36Updated 11 months ago
Alternatives and similar repositories for apiary:
Users that are interested in apiary are comparing it to the libraries listed below
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- Open Source Secret Provider plugin for the Kafka Connect framework☆46Updated 7 months ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆44Updated 2 years ago
- Amundsen Gremlin☆21Updated 2 years ago
- ☆14Updated last month
- Service for automatically managing and cleaning up unreferenced data☆46Updated last month
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 3 years ago
- Spark Scala docker container sample for AWS testing - EKS & S3☆24Updated 6 years ago
- Apache Ranger Plugin for S3☆19Updated 2 years ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆62Updated 3 months ago
- Graph Analytics with Apache Kafka☆104Updated this week
- Performance optimization for Spark running on Kubernetes☆87Updated 4 years ago
- Provide functionality to build statistical models to repair dirty tabular data in Spark☆12Updated last year
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- An application that records stats about consumer group offset commits and reports them as prometheus metrics☆14Updated 5 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆66Updated 2 weeks ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆19Updated 4 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Jupyter Integration for Flink SQL via Ververica Platform☆43Updated last year
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Ecosystem website for Apache Flink☆11Updated last year
- Setup for running Trino with Hive Metastore on Kubernetes☆100Updated 2 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http:…☆71Updated 2 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated last month
- Spark stream from kafka(json) to s3(parquet)☆15Updated 6 years ago
- Reference architecture for real-time stream processing with Apache Flink on Amazon EMR, Amazon Kinesis, and Amazon Elasticsearch Service.☆71Updated last year