ExpediaGroup / apiary
Apiary provides modules which can be combined to create a federated cloud data lake
☆36Updated last year
Alternatives and similar repositories for apiary:
Users that are interested in apiary are comparing it to the libraries listed below
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 3 years ago
- Amundsen Gremlin☆21Updated 2 years ago
- ☆14Updated 2 months ago
- Service for automatically managing and cleaning up unreferenced data☆46Updated last week
- Extensions available for use in Apiary☆11Updated this week
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆51Updated last year
- Ecosystem website for Apache Flink☆12Updated last year
- Amazon EMR on EKS Custom Image CLI☆31Updated 7 months ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆45Updated 2 years ago
- Dione - a Spark and HDFS indexing library☆52Updated last year
- Graph Analytics with Apache Kafka☆104Updated last week
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Cloud Storage Connector integrates Apache Pulsar with cloud storage.☆28Updated last month
- Open Source Secret Provider plugin for the Kafka Connect framework☆46Updated 9 months ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 2 weeks ago
- Performance optimization for Spark running on Kubernetes☆87Updated 4 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Mutation testing framework and code coverage for Hive SQL☆24Updated 3 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆60Updated 2 years ago
- Jupyter Integration for Flink SQL via Ververica Platform☆42Updated last year
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆30Updated 6 months ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆61Updated 5 months ago
- Reference architecture for real-time stream processing with Apache Flink on Amazon EMR, Amazon Kinesis, and Amazon Elasticsearch Service.☆71Updated last year
- Utility project for working with Kafka Connect.☆34Updated 9 months ago
- Setup for running Trino with Hive Metastore on Kubernetes☆101Updated 2 years ago