ryandawsonuk / data-platforms-toolsLinks
Guide to data platforms and tools
☆32Updated 3 years ago
Alternatives and similar repositories for data-platforms-tools
Users that are interested in data-platforms-tools are comparing it to the libraries listed below
Sorting:
- Data Mesh Architecture☆84Updated last month
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆354Updated this week
- ☆98Updated 2 years ago
- Data Tools Subjective List☆88Updated 2 years ago
- Curated list of resources about Apache Airflow☆19Updated 4 years ago
- Sample configuration to deploy a modern data platform.☆89Updated 3 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 3 years ago
- Weekly Data Engineering Newsletter☆97Updated last year
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆65Updated last week
- A Table format agnostic data sharing framework☆42Updated last year
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆77Updated last week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆176Updated 3 weeks ago
- A curated list of resources about Snowflake☆251Updated last year
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆67Updated 3 years ago
- A curated list of awesome Databricks resources, including Spark☆22Updated last year
- The go to demo for public and private dbt Learn☆80Updated 8 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆97Updated last week
- Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…☆28Updated 2 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆52Updated 5 months ago
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆159Updated 3 years ago
- Writing PySpark logs in Apache Spark and Databricks☆17Updated 3 years ago
- Delta Lake Documentation☆51Updated last year
- ☆42Updated 5 years ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆113Updated 2 years ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆39Updated 9 months ago
- Anomstack - Painless open source anomaly detection for your metrics 📈📉🚀☆106Updated last month
- Faker for Snowflake!☆33Updated 2 years ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆125Updated 4 years ago
- Delta lake and filesystem helper methods☆51Updated last year
- Schema modelling framework for decentralised domain-driven ownership of data.☆259Updated 2 years ago