Alternatives and similar repositories for rovio-ingest

Users that are interested in rovio-ingest are comparing it to the libraries listed below

• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆52Updated 2 months ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated 9 months ago
• AbsaOSS / spark-hofs
  Scala API for Apache Spark SQL high-order functions
  ☆14Updated 2 years ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆29Updated last week
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 4 years ago
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆112Updated 5 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated last year
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆45Updated last month
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆118Updated this week
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 11 months ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated this week
• DataSQRL / sqrl
  Data Pipeline Automation Framework to build MCP servers, data APIs, and data lakes with SQL.
  ☆127Updated this week
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆96Updated this week
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• apache / incubator-retired-amaterasu
  Apache Amaterasu
  ☆56Updated 5 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated last month
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 6 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated last week
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 5 years ago
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆29Updated 5 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆90Updated last year
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 4 months ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆100Updated 8 years ago
• apache / incubator-datalab
  Apache DataLab (incubating)
  ☆152Updated last year
• timgent / data-flare
  Data quality control tool built on spark and deequ
  ☆25Updated 5 months ago