Iceberg is a table format for large, slow-moving tabular data
☆490Apr 10, 2023Updated 2 years ago
Alternatives and similar repositories for iceberg
Users that are interested in iceberg are comparing it to the libraries listed below
Sorting:
- Hadoop output committers for S3☆113Jul 9, 2020Updated 5 years ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,608Updated this week
- Apache Iceberg☆8,572Feb 26, 2026Updated last week
- ☆1,687Updated this week
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆431Jan 14, 2022Updated 4 years ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆227Mar 19, 2025Updated 11 months ago
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆304Oct 30, 2025Updated 4 months ago
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,371Aug 22, 2023Updated 2 years ago
- Starburst Enterprise Distribution of Presto☆45Aug 31, 2021Updated 4 years ago
- A load balancer / proxy / gateway for prestodb☆358Jul 25, 2024Updated last year
- Big Data Processing Framework - Unified Data API or SQL on Any Storage☆251Jul 10, 2025Updated 7 months ago
- Upserts, Deletes And Incremental Processing on Big Data.☆6,103Updated this week
- Data Lineage Tracking And Visualization Solution☆656Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆2,132Updated this week
- Distributed Big Data Orchestration Service☆1,762Jan 31, 2026Updated last month
- A Scala API for Apache Beam and Google Cloud Dataflow.☆2,617Updated this week
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆889Feb 9, 2026Updated 3 weeks ago
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,261Updated this week
- Apache Pinot - A realtime distributed OLAP datastore☆6,037Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,588Feb 17, 2026Updated 2 weeks ago
- Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.☆946Feb 26, 2026Updated last week
- Qubole Sparklens tool for performance tuning Apache Spark☆590Jun 26, 2024Updated last year
- Use SQL to transform your avro schema/records☆28Jan 12, 2018Updated 8 years ago
- Mirror of Apache Bahir☆335Jul 7, 2023Updated 2 years ago
- Albis: High-Performance File Format for Big Data Systems☆21Jul 12, 2018Updated 7 years ago
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,425Updated this week
- Jupyter magics and kernels for working with remote Spark clusters☆1,362Sep 9, 2025Updated 5 months ago
- Hive + Avro. Serde for working with Avro in Hive☆59Dec 16, 2023Updated 2 years ago
- REST job server for Apache Spark☆2,843Jul 8, 2025Updated 7 months ago
- Base classes to use when writing tests with Spark☆1,549Dec 22, 2025Updated 2 months ago
- An Open Standard for lineage metadata collection☆2,330Updated this week
- Scala API for Apache Spark SQL high-order functions☆14Aug 4, 2023Updated 2 years ago
- Generic Data Ingestion & Dispersal Library for Hadoop☆482Mar 19, 2023Updated 2 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆96Jul 7, 2021Updated 4 years ago
- Mirror of Apache Toree (Incubating)☆749Feb 21, 2026Updated last week
- Apache Parquet Java☆3,030Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,543Updated this week
- Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…☆96Nov 14, 2019Updated 6 years ago
- Secor is a service implementing Kafka log persistence☆1,858Feb 25, 2026Updated last week