fingltd / 4mc
4mc - splittable lz4 and zstd in hadoop/spark/flink
☆108Updated last year
Related projects ⓘ
Alternatives and complementary repositories for 4mc
- Spark SQL index for Parquet tables☆132Updated 3 years ago
- Read SparkSQL parquet file as RDD[Protobuf]☆93Updated 6 years ago
- Website for DataSketches.☆95Updated this week
- Google Dataflow Runner for Apache Flink™ (deprecated; please use the up-to-date Beam Runner)☆88Updated 8 years ago
- Cache File System optimized for columnar formats and object stores☆183Updated 2 years ago
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Updated 7 years ago
- GlusterFS plugin for Hadoop HCFS☆69Updated 2 years ago
- Presto ODBC Driver☆27Updated 10 years ago
- Mirror of Apache Slider☆79Updated 5 years ago
- Sql interface to druid.☆77Updated 8 years ago
- libhdfs++ is a modern implementation of HDFS client in C++11 that is designed for the Massive Parallel Processing (MPP) applications.☆27Updated 9 years ago
- Mirror of Apache DataFu☆118Updated 3 weeks ago
- A library to expose more of Apache Spark's metrics system☆146Updated 4 years ago
- Fast JVM collection☆59Updated 9 years ago
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 8 years ago
- Druid indexing plugin for using Spark in batch jobs☆101Updated 3 years ago
- Cascading on Apache Flink®☆54Updated 9 months ago
- Albis: High-Performance File Format for Big Data Systems☆21Updated 6 years ago
- Drizzle integration with Apache Spark☆120Updated 6 years ago
- Tool for gathering blocks and replicas meta data from HDFS. It also builds a heat map showing how replicas are distributed along disks an…☆56Updated 7 years ago
- Starburst Enterprise Distribution of Presto☆46Updated 3 years ago
- Hadoop output committers for S3☆108Updated 4 years ago
- A tool for scale and performance testing of HDFS with a specific focus on the NameNode.☆131Updated 10 months ago
- Remedy small files by combining them into larger ones.☆193Updated 2 years ago
- Quark is a data virtualization engine over analytic databases.☆99Updated 7 years ago
- Hannibal is tool to help monitor and maintain HBase-Clusters that are configured for manual splitting.☆172Updated 6 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Updated 8 years ago
- A Tez dev-setup for HDP2 sandbox☆21Updated last year