edwardcapriolo / filecrush
Remedy small files by combining them into larger ones.
☆193Updated 2 years ago
Alternatives and similar repositories for filecrush:
Users that are interested in filecrush are comparing it to the libraries listed below
- Low level integration of Spark and Kafka☆130Updated 6 years ago
- REST job server for Spark. Note that this is *not* the mainline open source version. For that, go to https://github.com/spark-jobserver…☆344Updated 7 years ago
- Kite SDK Examples☆99Updated 3 years ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆241Updated 9 years ago
- Example programs and scripts for accessing parquet files☆30Updated 7 years ago
- ☆57Updated 5 years ago
- Kafka as Hive Storage☆66Updated 10 years ago
- Mirror of Apache Slider☆78Updated 6 years ago
- Hadoop Job for schemaless incremental loading of messages from Kafka topics onto hdfs with configurable output partitioning.☆90Updated 8 years ago
- spark + drools☆102Updated 2 years ago
- ☆54Updated 10 years ago
- Learning to write Spark examples☆160Updated 10 years ago
- Spark Structured Streaming Kafka 0.8 Source Implementation☆35Updated 7 years ago
- Mirror of Apache Atlas (Incubating)☆95Updated last year
- Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.☆50Updated 8 years ago
- Druid indexing plugin for using Spark in batch jobs☆101Updated 3 years ago
- Utility to easily copy files into HDFS☆69Updated 4 years ago
- Ambari service for Apache Zeppelin notebook☆71Updated 7 years ago
- A library to expose more of Apache Spark's metrics system☆146Updated 5 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆159Updated 2 years ago
- Plugin for Presto to allow addition of user functions easily☆116Updated 3 years ago
- Hannibal is tool to help monitor and maintain HBase-Clusters that are configured for manual splitting.☆172Updated 7 years ago
- Hadoop MapReduce tool to convert Avro data files to Parquet format.☆34Updated 11 years ago
- Spark Streaming HBase Example☆95Updated 8 years ago
- Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…☆283Updated 6 years ago
- Write your Spark data to Kafka seamlessly☆175Updated 6 months ago
- Sql interface to druid.☆77Updated 9 years ago
- ☆244Updated 6 years ago
- File compaction tool that runs on top of the Spark framework.☆59Updated 5 years ago
- Tools for spark which we use on the daily basis☆64Updated 4 years ago