fingltd / 4mcLinks
4mc - splittable lz4 and zstd in hadoop/spark/flink
☆109Updated 2 years ago
Alternatives and similar repositories for 4mc
Users that are interested in 4mc are comparing it to the libraries listed below
Sorting:
- Spark SQL index for Parquet tables☆134Updated 4 years ago
- BlinkDB: Sub-Second Approximate Queries on Very Large Data.☆660Updated 11 years ago
- Cache File System optimized for columnar formats and object stores☆184Updated 3 years ago
- Splittable Gzip codec for Hadoop☆74Updated 3 weeks ago
- Secondary sort and streaming reduce for Apache Spark☆78Updated 2 years ago
- Read SparkSQL parquet file as RDD[Protobuf]☆93Updated 7 years ago
- An efficient updatable key-value store for Apache Spark☆254Updated 8 years ago
- Enabling queries on compressed data.☆281Updated last year
- Easy CPU Profiling for Apache Spark applications☆48Updated 5 years ago
- Live-updating Spark UI built with Meteor☆189Updated 4 years ago
- The SpliceSQL Engine☆170Updated 2 years ago
- Google Dataflow Runner for Apache Flink™ (deprecated; please use the up-to-date Beam Runner)☆88Updated 9 years ago
- Scripts to analyze Spark's performance☆136Updated 7 years ago
- Remedy small files by combining them into larger ones.☆194Updated 3 years ago
- Stocator is high performing connector to object storage for Apache Spark, achieving performance by leveraging object storage semantics.☆114Updated last year
- Visualize your HDFS cluster usage☆229Updated 5 years ago
- Tools for working with parquet, impala, and hive☆134Updated 4 years ago
- Spark RDD with Lucene's query and entity linkage capabilities☆128Updated last month
- Drizzle integration with Apache Spark☆120Updated 7 years ago
- libhdfs++ is a modern implementation of HDFS client in C++11 that is designed for the Massive Parallel Processing (MPP) applications.☆28Updated 10 years ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆240Updated 10 years ago
- Hadoop output committers for S3☆111Updated 5 years ago
- Mirror of Apache DataFu☆120Updated 5 months ago
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Updated 8 years ago
- A tool for scale and performance testing of HDFS with a specific focus on the NameNode.☆134Updated last year
- Website for DataSketches.☆104Updated last month
- Refactored version of code.google.com/hadoop-gpl-compression for hadoop 0.20☆552Updated last year
- A tool and library for easily deploying applications on Apache YARN☆146Updated last year
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆128Updated 7 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 5 years ago