ryandawsonuk / data-platforms-toolsLinks
Guide to data platforms and tools
☆32Updated 3 years ago
Alternatives and similar repositories for data-platforms-tools
Users that are interested in data-platforms-tools are comparing it to the libraries listed below
Sorting:
- Data Mesh Architecture☆84Updated 3 months ago
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆355Updated this week
- ☆100Updated 2 years ago
- Data Tools Subjective List☆89Updated 2 years ago
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆70Updated last month
- A curated list of awesome Databricks resources, including Spark☆22Updated last year
- Weekly Data Engineering Newsletter☆96Updated last year
- Sample configuration to deploy a modern data platform.☆89Updated 4 years ago
- Faker for Snowflake!☆33Updated 3 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Updated 3 years ago
- A curated list of resources about Snowflake☆256Updated last year
- ☆42Updated 5 years ago
- Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…☆28Updated 2 years ago
- Anomstack - Painless open source anomaly detection for your metrics 📈📉🚀☆107Updated last week
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆160Updated 3 years ago
- The go to demo for public and private dbt Learn☆82Updated 10 months ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆127Updated 4 years ago
- Delta Lake Documentation☆53Updated last year
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆113Updated 2 years ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆97Updated this week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆183Updated last month
- Collection of dockerized ETL jobs managed by data engineering.☆21Updated last week
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 4 months ago
- Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.☆38Updated 3 years ago
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆49Updated last year
- A curated list of awesome DataOps tools☆225Updated 2 months ago
- Utility functions for dbt projects running on Spark☆34Updated last month
- Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match☆493Updated this week
- Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub☆336Updated 2 years ago
- Build and deploy a serverless data pipeline on AWS with no effort.☆110Updated 3 years ago