UrbanOS-Public / kdp
Kubernetes deployment of PrestoDB, Hive Metastore, and Minio S3-standard object store
☆17Updated 2 years ago
Alternatives and similar repositories for kdp:
Users that are interested in kdp are comparing it to the libraries listed below
- Helm Chart for lyft/flinkk8soperator☆11Updated 5 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated 11 months ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Hadoop Data Pipeline using Falcon☆15Updated 8 years ago
- Presto K8S Operator☆9Updated 4 years ago
- Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol☆34Updated 2 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Discover Flink clusters on Hadoop YARN for Prometheus☆23Updated 4 years ago
- ☆40Updated last year
- ☆10Updated 2 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- HADOOP-CLI is an interactive command line shell that makes interacting with the Hadoop Distribted Filesystem (HDFS) simpler and more intu…☆36Updated 9 months ago
- A Spark metrics sink that pushes to InfluxDb☆51Updated 4 years ago
- HDFS Automatic Snapshot Service for Linux☆12Updated 8 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Updated 8 years ago
- Allows wrapping existing WebUI pages and present them as Ambari Views☆9Updated 9 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆82Updated 4 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆100Updated 2 years ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆19Updated 7 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆66Updated 2 weeks ago
- Provide functionality to build statistical models to repair dirty tabular data in Spark☆12Updated last year
- Performance optimization for Spark running on Kubernetes☆87Updated 4 years ago
- ☆39Updated 6 years ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 3 years ago
- Presto cluster on top of kubernetes☆18Updated 5 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 7 years ago
- a smart, automated non-intrusive driver for hbase region-level major-compact☆8Updated 8 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated 2 weeks ago