edwardcapriolo / filecrush
Remedy small files by combining them into larger ones.
☆193Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for filecrush
- Hadoop Job for schemaless incremental loading of messages from Kafka topics onto hdfs with configurable output partitioning.☆90Updated 8 years ago
- Low level integration of Spark and Kafka☆130Updated 6 years ago
- Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…☆284Updated 6 years ago
- Hannibal is tool to help monitor and maintain HBase-Clusters that are configured for manual splitting.☆172Updated 6 years ago
- File compaction tool that runs on top of the Spark framework.☆59Updated 5 years ago
- Mirror of Apache Slider☆79Updated 5 years ago
- A library to expose more of Apache Spark's metrics system☆146Updated 4 years ago
- Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.☆51Updated 8 years ago
- Ambari service for Apache Zeppelin notebook☆71Updated 7 years ago
- Hadoop MapReduce tool to convert Avro data files to Parquet format.☆34Updated 11 years ago
- Utility to easily copy files into HDFS☆69Updated 4 years ago
- ☆245Updated 6 years ago
- Mirror of Apache Atlas (Incubating)☆95Updated last year
- Sql interface to druid.☆77Updated 8 years ago
- Spark Streaming HBase Example☆96Updated 8 years ago
- Kafka as Hive Storage☆67Updated 10 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 6 years ago
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆125Updated 6 years ago
- Spark Structured Streaming Kafka 0.8 Source Implementation☆35Updated 7 years ago
- An example of using Avro and Parquet in Spark SQL☆60Updated 9 years ago
- Helpful user defined fuctions / table generating functions for Hive☆101Updated 8 years ago
- ☆57Updated 5 years ago
- A super simple utility for testing Apache Hive scripts locally for non-Java developers.☆72Updated 7 years ago
- ☆92Updated 7 years ago
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 8 years ago