provectus / streaming-data-platformLinks
☆24Updated 3 years ago
Alternatives and similar repositories for streaming-data-platform
Users that are interested in streaming-data-platform are comparing it to the libraries listed below
Sorting:
- Reference Dockerfiles for production usage☆24Updated 6 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆91Updated last year
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆70Updated 5 months ago
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆67Updated 4 years ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- Aiven's collection of Single Message Transformations (SMTs) for Apache Kafka Connect☆87Updated 4 months ago
- Swiss Army Kube (SAK) is an open-source IaC (Infrastructure as Code) collection of services for quick, easy, and controllable deployment …☆147Updated 2 months ago
- A Spark plugin for CPU and memory profiling☆20Updated last year
- Data Quality Gate based on AWS☆57Updated last year
- Common Transforms for Kafka Connect.☆171Updated 2 weeks ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆45Updated 2 years ago
- ☆81Updated 9 months ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆39Updated 11 months ago
- ITSumma Spark Greenplum Connector☆42Updated last year
- Kafka Connector for Iceberg tables☆16Updated 2 years ago
- A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational e…☆110Updated this week
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 4 years ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated 2 years ago
- The Internals of Spark on Kubernetes☆72Updated 3 years ago
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Updated 3 years ago
- ☆65Updated last year
- ☆100Updated 2 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 8 months ago
- Data validation library for PySpark 3.0.0☆33Updated 3 years ago
- Apache Ranger Plugin for S3☆20Updated 3 years ago
- Kafka Connect FileSystem Connector☆113Updated 3 years ago
- JSON schema parser for Apache Spark☆82Updated 3 years ago
- DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.☆268Updated 10 months ago
- Spark to Tableau Extractor library☆19Updated 8 years ago
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆83Updated 9 months ago