Generic Data Ingestion & Dispersal Library for Hadoop
☆482Mar 19, 2023Updated 2 years ago
Alternatives and similar repositories for marmaray
Users that are interested in marmaray are comparing it to the libraries listed below
Sorting:
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,260Feb 19, 2026Updated last week
- Upserts, Deletes And Incremental Processing on Big Data.☆6,103Updated this week
- A simplified, lightweight ETL Framework based on Apache Spark☆587Jan 24, 2024Updated 2 years ago
- ☆1,687Feb 19, 2026Updated last week
- SQL-based streaming analytics platform at scale☆1,226Jun 21, 2020Updated 5 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,583Feb 17, 2026Updated last week
- Mirror of Apache crail (Incubating)☆151Jul 3, 2022Updated 3 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,304Feb 23, 2026Updated last week
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆160Dec 10, 2022Updated 3 years ago
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,371Aug 22, 2023Updated 2 years ago
- Big Data Processing Framework - Unified Data API or SQL on Any Storage☆251Jul 10, 2025Updated 7 months ago
- Qubole Sparklens tool for performance tuning Apache Spark☆590Jun 26, 2024Updated last year
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr …☆8,602Feb 21, 2026Updated last week
- StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service☆364Mar 19, 2023Updated 2 years ago
- Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies…☆1,113Jan 12, 2023Updated 3 years ago
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆303Oct 30, 2025Updated 4 months ago
- ☆63Nov 8, 2019Updated 6 years ago
- An extensible distributed system for reliable nearline data streaming at scale☆956Updated this week
- A load balancer / proxy / gateway for prestodb☆358Jul 25, 2024Updated last year
- Data Lineage Tracking And Visualization Solution☆656Updated this week
- Quark is a data virtualization engine over analytic databases.☆101Jul 13, 2017Updated 8 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆334Sep 29, 2023Updated 2 years ago
- Egeria core☆897Feb 19, 2026Updated last week
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆432Jan 14, 2022Updated 4 years ago
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,740Feb 19, 2026Updated last week
- JVM Profiler Sending Metrics to Kafka, Console Output or Custom Reporter☆1,806Jul 12, 2025Updated 7 months ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,879Jan 2, 2026Updated last month
- High performance data store solution☆1,446Feb 21, 2026Updated last week
- Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in…☆1,037Nov 21, 2022Updated 3 years ago
- Dremio - the missing link in modern data☆1,469Sep 26, 2025Updated 5 months ago
- Pravega - Streaming as a new software defined storage primitive☆2,005Mar 2, 2025Updated 11 months ago
- Mirror of Apache griffin☆1,174Aug 3, 2025Updated 6 months ago
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆888Feb 9, 2026Updated 3 weeks ago
- Essential Spark extensions and helper methods ✨😲☆766Sep 14, 2025Updated 5 months ago
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,106Updated this week
- an open source dataworks platform☆21Jun 4, 2021Updated 4 years ago
- Iceberg is a table format for large, slow-moving tabular data☆490Apr 10, 2023Updated 2 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆97Jul 7, 2021Updated 4 years ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆29Nov 4, 2024Updated last year