aviatesk / deequLinks
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
☆9Updated 3 years ago
Alternatives and similar repositories for deequ
Users that are interested in deequ are comparing it to the libraries listed below
Sorting:
- Mutation testing framework and code coverage for Hive SQL☆24Updated 4 years ago
- ☆22Updated 6 years ago
- Dione - a Spark and HDFS indexing library☆52Updated last year
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆61Updated 6 months ago
- Paper: A Zero-rename committer for object stores☆20Updated 4 years ago
- Docker images for Presto integration testing☆35Updated 11 months ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 6 years ago
- Sketching data structures for scala, including t-digest☆15Updated 3 years ago
- Extensible streaming ingestion pipeline on top of Apache Spark☆44Updated last week
- Service for automatically managing and cleaning up unreferenced data☆47Updated last week
- A testing framework for Trino☆26Updated 2 months ago
- Lenses.io CLI (command-line interface)☆36Updated 6 months ago
- A command line client for consuming Postgres logical decoding events in the pgoutput format☆11Updated 11 months ago
- A small project to allow publishing data to Apache Kafka, Apache Pulsar or any other target system☆14Updated 4 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- Hive Storage Handler for Kinesis.☆11Updated 10 years ago
- BigQuery connector for Apache Flink☆31Updated 2 weeks ago
- Example of a tested Apache Flink application.☆42Updated 5 years ago
- A table schema-less OLAP Analytics Engine for Big Data.☆24Updated last year
- LimestoneDB is a real-time columnar database☆9Updated 5 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆68Updated 3 months ago
- A Giter8 template for scio☆31Updated 4 months ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- DBeam exports SQL tables into Avro files using JDBC and Apache Beam☆195Updated this week
- A library that brings useful functions from various modern database management systems to Apache Spark☆59Updated last year
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 3 years ago
- A Python Client for Hive Metastore☆12Updated last year
- The ZetaSQL Toolkit is a library that helps users use ZetaSQL Java API to perform SQL analysis for multiple query engines, including BigQ…☆41Updated last month