Generic Data Ingestion & Dispersal Library for Hadoop
☆482Mar 19, 2023Updated 3 years ago
Alternatives and similar repositories for marmaray
Users that are interested in marmaray are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,260Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆6,118Updated this week
- A simplified, lightweight ETL Framework based on Apache Spark☆587Jan 24, 2024Updated 2 years ago
- ☆1,685Feb 27, 2026Updated 3 weeks ago
- SQL-based streaming analytics platform at scale☆1,226Jun 21, 2020Updated 5 years ago
- StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service☆363Mar 19, 2023Updated 3 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,596Mar 10, 2026Updated last week
- Mirror of Apache crail (Incubating)☆150Jul 3, 2022Updated 3 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆590Jun 26, 2024Updated last year
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆160Dec 10, 2022Updated 3 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,310Mar 14, 2026Updated last week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,637Updated this week
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,369Aug 22, 2023Updated 2 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆305Oct 30, 2025Updated 4 months ago
- JVM Profiler Sending Metrics to Kafka, Console Output or Custom Reporter☆1,804Mar 1, 2026Updated 3 weeks ago
- ☆63Nov 8, 2019Updated 6 years ago
- Big Data Processing Framework - Unified Data API or SQL on Any Storage☆250Jul 10, 2025Updated 8 months ago
- Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies…☆1,113Jan 12, 2023Updated 3 years ago
- An extensible distributed system for reliable nearline data streaming at scale☆958Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,880Jan 2, 2026Updated 2 months ago
- Iceberg is a table format for large, slow-moving tabular data☆490Apr 10, 2023Updated 2 years ago
- A load balancer / proxy / gateway for prestodb☆358Jul 25, 2024Updated last year
- Pravega - Streaming as a new software defined storage primitive☆2,005Mar 2, 2025Updated last year
- Apache Iceberg☆8,636Updated this week
- Dremio - the missing link in modern data☆1,475Sep 26, 2025Updated 5 months ago
- Data Lineage Tracking And Visualization Solution☆656Updated this week
- Mirror of Apache griffin☆1,171Aug 3, 2025Updated 7 months ago
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,106Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,749Mar 10, 2026Updated last week
- Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in…☆1,035Nov 21, 2022Updated 3 years ago
- Quark is a data virtualization engine over analytic databases.☆100Jul 13, 2017Updated 8 years ago
- Apache YuniKorn Core☆1,004Updated this week
- A visual ETL development and debugging tool for big data☆155Dec 5, 2022Updated 3 years ago
- Parsing and analysis of Vertica, Hive, and Presto SQL.☆1,081Feb 16, 2022Updated 4 years ago
- an open source dataworks platform☆21Jun 4, 2021Updated 4 years ago
- Essential Spark extensions and helper methods ✨😲☆766Sep 14, 2025Updated 6 months ago
- Secor is a service implementing Kafka log persistence☆1,857Mar 10, 2026Updated last week
- High performance data store solution☆1,446Mar 11, 2026Updated last week