A simplified, lightweight ETL Framework based on Apache Spark
☆588Jan 24, 2024Updated 2 years ago
Alternatives and similar repositories for metorikku
Users that are interested in metorikku are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple Spark-powered ETL framework that just works 🍺☆185Oct 2, 2025Updated 9 months ago
- Qubole Sparklens tool for performance tuning Apache Spark☆592Jun 26, 2024Updated 2 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,631Updated this week
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆129Updated this week
- Essential Spark extensions and helper methods ✨😲☆767Jun 22, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Data Lineage Tracking And Visualization Solution☆662Updated this week
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆827May 19, 2026Updated last month
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,351Updated this week
- Apache Spark ETL Utilities☆40Oct 23, 2024Updated last year
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆306Jun 29, 2026Updated 2 weeks ago
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆76Apr 24, 2024Updated 2 years ago
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆906Jun 9, 2026Updated last month
- Extensible streaming ingestion pipeline on top of Apache Spark☆47Jul 17, 2025Updated 11 months ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,905Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,782Jul 1, 2026Updated 2 weeks ago
- Generic Data Ingestion & Dispersal Library for Hadoop☆482Mar 19, 2023Updated 3 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Jun 7, 2021Updated 5 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆162Oct 4, 2022Updated 3 years ago
- Upserts, Deletes And Incremental Processing on Big Data.☆6,186Updated this week
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆430Jan 14, 2022Updated 4 years ago
- Base classes to use when writing tests with Spark☆1,552Apr 20, 2026Updated 2 months ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆458Apr 2, 2026Updated 3 months ago
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆255Feb 21, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A library that provides useful extensions to Apache Spark and PySpark.☆238Jul 1, 2026Updated last week
- Stream computing platform for bigdata☆406Apr 24, 2024Updated 2 years ago
- Expressive types for Spark.☆898Updated this week
- ACID Data Source for Apache Spark based on Hive ACID☆97Jul 7, 2021Updated 5 years ago
- Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies…☆1,111Jan 12, 2023Updated 3 years ago
- Spline agent for Apache Spark☆206Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆2,240Jul 6, 2026Updated last week
- A Spark Atlas connector to track data lineage in Apache Atlas☆268Nov 16, 2022Updated 3 years ago
- Jupyter magics and kernels for working with remote Spark clusters☆1,362Sep 9, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.☆959Updated this week
- Snowflake Data Source for Apache Spark.☆231Updated this week
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆40Jun 29, 2017Updated 9 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆64Sep 6, 2024Updated last year
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆97Updated this week
- pyspark methods to enhance developer productivity 📣 👯 🎉☆687Jun 9, 2026Updated last month
- The Context Platform for your Data and AI Stack☆12,272Updated this week