Netflix / iceberg
Iceberg is a table format for large, slow-moving tabular data
☆478Updated 2 years ago
Alternatives and similar repositories for iceberg:
Users that are interested in iceberg are comparing it to the libraries listed below
- Qubole Sparklens tool for performance tuning Apache Spark☆575Updated 10 months ago
- A load balancer / proxy / gateway for prestodb☆358Updated 9 months ago
- A tool for monitoring and tuning Spark jobs for efficiency.☆358Updated 2 years ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆745Updated 3 weeks ago
- Cache File System optimized for columnar formats and object stores☆182Updated 2 years ago
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆299Updated last year
- Hadoop output committers for S3☆109Updated 4 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆185Updated 2 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆345Updated 11 months ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆220Updated last month
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆425Updated 3 years ago
- Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.☆909Updated 2 weeks ago
- Build configuration-driven ETL pipelines on Apache Spark☆159Updated 2 years ago
- ReAir is a collection of easy-to-use tools for replicating tables and partitions between Hive data warehouses.☆282Updated 6 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆585Updated last year
- Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…☆282Updated 6 years ago
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,356Updated last year
- Kinesis Connector for Structured Streaming☆136Updated 10 months ago
- Snowflake Data Source for Apache Spark.☆225Updated last month
- Avro SerDe for Apache Spark structured APIs.☆234Updated 9 months ago
- Data Lineage Tracking And Visualization Solution☆622Updated this week
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆327Updated last year
- Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in…☆1,037Updated 2 years ago
- Hive federation service. Enables disparate tables to be concurrently accessed across multiple Hive deployments.☆283Updated last month
- Generic Data Ingestion & Dispersal Library for Hadoop☆478Updated 2 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆181Updated 2 years ago
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆126Updated 6 years ago
- An Open Source unit test framework for Hive queries based on JUnit 4 and 5☆257Updated 4 months ago
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,007Updated 2 years ago
- Data ingestion library for Amundsen to build graph and search index☆205Updated last year