Alternatives and similar repositories for parquet-generator:

Users that are interested in parquet-generator are comparing it to the libraries listed below

• zrlio / crail-spark-io
  Fast I/O plugins for Spark
  ☆41Updated 4 years ago
• oap-project / remote-shuffle
  Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…
  ☆21Updated last year
• zrlio / albis
  Albis: High-Performance File Format for Big Data Systems
  ☆21Updated 6 years ago
• Intel-bigdata / Spark-PMoF
  Spark Shuffle Optimization with RDMA+AEP
  ☆30Updated last year
• apache / incubator-crail
  Mirror of Apache crail (Incubating)
  ☆150Updated 2 years ago
• MemVerge / splash
  Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
  ☆127Updated 4 months ago
• openucx / sparkucx
  A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
  ☆50Updated last year
• maropu / spark-tpcds-datagen
  All the things about TPC-DS in Apache Spark
  ☆105Updated last year
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• rheem-ecosystem / rheem
  Rheem - a cross-platform data processing system
  ☆5Updated 3 years ago
• cerndb / Hadoop-Profiler
  Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.
  ☆24Updated 8 years ago
• TU-Berlin-DIMA / scotty-window-processor
  This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.
  ☆77Updated last year
• qubole / streaminglens
  Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines
  ☆17Updated 5 years ago
• substrait-io / substrait-java
  ☆85Updated last week
• microsoft / Dhalion
  Self regulation and auto-tuning for distributed system
  ☆65Updated last year
• qubole / rubix
  Cache File System optimized for columnar formats and object stores
  ☆182Updated 2 years ago
• Teradata / tpcds
  Port of TPC-DS dsdgen to Java
  ☆49Updated 9 months ago
• strymon-system / ds2
  DS2 is an auto-scaling controller for distributed streaming dataflows
  ☆89Updated 2 years ago
• rymurr / flight-spark-source
  ☆105Updated last year
• zrlio / crail
  [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O
  ☆73Updated 7 years ago
• TU-Berlin-DIMA / Condor
  Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …
  ☆13Updated 10 months ago
• lsds / StreamBench
  Measuring the performance of popular streaming engines with Yahoo's Streaming Benchmark
  ☆53Updated 5 years ago
• vlsi / calcite-test-dataset
  Data sets and Vagrant script to provision a virtual machine for Apache Calcite development
  ☆30Updated 2 years ago
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• ehiggs / spark-terasort
  Spark Terasort
  ☆122Updated 2 years ago
• dataArtisans / yahoo-streaming-benchmark
  An extension of Yahoo's Benchmarks
  ☆107Updated last year
• squito / spark-memory
  A tool to get better debug info on spark's memory usage
  ☆42Updated 5 years ago
• ibm-research-ireland / sparkoscope
  Enabling Spark Optimization through Cross-stack Monitoring and Visualization
  ☆47Updated 7 years ago
• amplab / drizzle-spark
  Drizzle integration with Apache Spark
  ☆120Updated 6 years ago
• CODAIT / stocator
  Stocator is high performing connector to object storage for Apache Spark, achieving performance by leveraging object storage semantics.
  ☆114Updated 11 months ago