TrivadisPF / platys
A tool for generating docker-compose environments
☆19Updated 3 months ago
Related projects: ⓘ
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆68Updated last week
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated 2 weeks ago
- The Data Product Descriptor Specification (DPDS) Repository☆66Updated this week
- A Data Mesh proof-of-concept built on Confluent Cloud☆2Updated last year
- ☆89Updated last year
- ☆12Updated 11 months ago
- Kafka as your DataLake Demo☆11Updated last year
- Minimal example to run Trino, Minio, and Hive standalone metastore on docker☆45Updated 2 years ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆91Updated this week
- GetInData Helm Charts repository☆12Updated 2 years ago
- ☆37Updated 6 months ago
- ☆13Updated last year
- Explore Apache Kafka data pipelines in Kubernetes.☆45Updated this week
- Various Demos mostly based on docker environments☆33Updated last year
- ☆21Updated 6 months ago
- Delta reader for the Ray open-source toolkit for building ML applications☆40Updated 7 months ago
- Full stack data engineering tools and infrastructure set-up☆38Updated 3 years ago
- A Table format agnostic data sharing framework☆36Updated 7 months ago
- Utility functions and base classes for Kafka Streams applications☆29Updated last month
- Docker envinroment to stream data from Kafka to Iceberg tables☆24Updated 6 months ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago
- ☆2Updated last year
- ☆32Updated 4 months ago
- Transporter for integrating OpenLineage with OpenMetadata☆11Updated 6 months ago
- Spark package for checking data quality☆25Updated last year
- Receipes of publicly-available Jupyter images☆8Updated last week
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- Snowflake Connector for Dremio using the ARP SDK.☆16Updated last year
- Chat with your data contracts with Data Contract GPT☆14Updated 3 months ago
- Yet Another (Spark) ETL Framework☆18Updated 10 months ago