dwarszawski / amundsen-atlas-types
Atlas custom type definitions
☆16Updated 3 years ago
Related projects: ⓘ
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆75Updated 4 months ago
- Setup for running Trino with Hive Metastore on Kubernetes☆98Updated 2 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆183Updated last year
- Multiple node presto cluster on docker container☆120Updated 2 years ago
- DataQuality for BigData☆139Updated 9 months ago
- A simple Spark-powered ETL framework that just works 🍺☆177Updated 9 months ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆111Updated last month
- Data validation library for PySpark 3.0.0☆34Updated last year
- The Internals of Delta Lake☆180Updated last month
- A library that provides useful extensions to Apache Spark and PySpark.☆193Updated last week
- This Apache Atlas is built from the latest release source tarball and patched to be run in a Docker container.☆139Updated 8 months ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆86Updated 6 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆91Updated this week
- Extensible Rules Engine for custom Dataframe / Dataset validation☆134Updated 4 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- Python API for Deequ☆41Updated 3 years ago
- Avro SerDe for Apache Spark structured APIs.☆228Updated last month
- Data ingestion library for Amundsen to build graph and search index☆206Updated 6 months ago
- ☆232Updated this week
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated 10 months ago
- spark on kubernetes☆105Updated last year
- ☆63Updated 4 years ago
- Storage connector for Trino☆90Updated 3 weeks ago
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- Replicates any database (CDC events) to Apache Iceberg (To Cloud Storage)☆179Updated this week
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆82Updated 5 months ago
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆104Updated this week
- Airflow support for Marquez☆32Updated 3 years ago
- Amundsen library to place common code for Amundsen microservices to share☆9Updated 3 years ago