edwardcapriolo / filecrush
Remedy small files by combining them into larger ones.
☆193Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for filecrush
- Low level integration of Spark and Kafka☆130Updated 6 years ago
- A library to expose more of Apache Spark's metrics system☆146Updated 4 years ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆241Updated 9 years ago
- Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.☆51Updated 8 years ago
- Mirror of Apache Atlas (Incubating)☆95Updated last year
- ☆245Updated 6 years ago
- Utility to easily copy files into HDFS☆69Updated 4 years ago
- Hannibal is tool to help monitor and maintain HBase-Clusters that are configured for manual splitting.☆172Updated 6 years ago
- REST job server for Spark. Note that this is *not* the mainline open source version. For that, go to https://github.com/spark-jobserver…☆344Updated 7 years ago
- Kafka as Hive Storage☆67Updated 9 years ago
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 8 years ago
- Hadoop Job for schemaless incremental loading of messages from Kafka topics onto hdfs with configurable output partitioning.☆90Updated 8 years ago
- Spark Structured Streaming Kafka 0.8 Source Implementation☆35Updated 7 years ago
- Sql interface to druid.☆77Updated 8 years ago
- Mirror of Apache Slider☆79Updated 5 years ago
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆125Updated 6 years ago
- Kite SDK Examples☆99Updated 3 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆158Updated 2 years ago
- ☆71Updated 7 years ago
- ☆92Updated 7 years ago
- Tools for spark which we use on the daily basis☆65Updated 4 years ago
- An example of using Avro and Parquet in Spark SQL☆60Updated 8 years ago
- Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…☆284Updated 6 years ago
- Example programs and scripts for accessing parquet files☆30Updated 6 years ago
- File compaction tool that runs on top of the Spark framework.☆59Updated 5 years ago
- Ambari service for Apache Zeppelin notebook☆71Updated 7 years ago