fingltd / 4mc
4mc - splittable lz4 and zstd in hadoop/spark/flink
☆109Updated last year
Alternatives and similar repositories for 4mc:
Users that are interested in 4mc are comparing it to the libraries listed below
- Spark SQL index for Parquet tables☆134Updated 3 years ago
- libhdfs++ is a modern implementation of HDFS client in C++11 that is designed for the Massive Parallel Processing (MPP) applications.☆27Updated 9 years ago
- Read SparkSQL parquet file as RDD[Protobuf]☆93Updated 6 years ago
- Website for DataSketches.☆95Updated this week
- Quark is a data virtualization engine over analytic databases.☆98Updated 7 years ago
- Secondary sort and streaming reduce for Apache Spark☆78Updated last year
- Hadoop output committers for S3☆108Updated 4 years ago
- Enabling queries on compressed data.☆278Updated last year
- Scripts to analyze Spark's performance☆136Updated 6 years ago
- Cache File System optimized for columnar formats and object stores☆182Updated 2 years ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated last month
- Drizzle integration with Apache Spark☆120Updated 6 years ago
- Albis: High-Performance File Format for Big Data Systems☆21Updated 6 years ago
- Spark RDD with Lucene's query and entity linkage capabilities☆124Updated 2 months ago
- A library to expose more of Apache Spark's metrics system☆146Updated 5 years ago
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Updated 7 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Updated 8 years ago
- Tool for gathering blocks and replicas meta data from HDFS. It also builds a heat map showing how replicas are distributed along disks an…☆56Updated 7 years ago
- BlinkDB: Sub-Second Approximate Queries on Very Large Data.☆660Updated 10 years ago
- A super simple utility for testing Apache Hive scripts locally for non-Java developers.☆72Updated 7 years ago
- Mirror of Apache Slider☆78Updated 6 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 4 years ago
- Sample UDF and UDAs for Impala.☆64Updated 5 years ago
- Low level integration of Spark and Kafka☆130Updated 6 years ago
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 8 years ago
- A Tez dev-setup for HDP2 sandbox☆21Updated last year