Alternatives and similar repositories for parquet-generator:

Users that are interested in parquet-generator are comparing it to the libraries listed below

• zrlio / albis
  Albis: High-Performance File Format for Big Data Systems
  ☆21Updated 6 years ago
• zrlio / crail-spark-io
  Fast I/O plugins for Spark
  ☆41Updated 4 years ago
• squito / spark-memory
  A tool to get better debug info on spark's memory usage
  ☆42Updated 5 years ago
• maropu / spark-tpcds-datagen
  All the things about TPC-DS in Apache Spark
  ☆104Updated last year
• openucx / sparkucx
  A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
  ☆49Updated last year
• assafmendelson / DataSourceV2
  ☆23Updated 6 years ago
• nielsbasjes / splittablegzip
  Splittable Gzip codec for Hadoop
  ☆70Updated 3 weeks ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• rtahboub / spark-sql-customized-parser
  An experiment to inject a customized parser using SparkSessionExtension
  ☆17Updated 7 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• paypal / dione
  Dione - a Spark and HDFS indexing library
  ☆51Updated 10 months ago
• MemVerge / splash
  Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
  ☆127Updated last month
• rymurr / flight-spark-source
  ☆105Updated last year
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• Intel-bigdata / Spark-PMoF
  Spark Shuffle Optimization with RDMA+AEP
  ☆30Updated last year
• uber / uberscriptquery
  UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy
  ☆62Updated last year
• oap-project / remote-shuffle
  Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…
  ☆21Updated 11 months ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆86Updated 10 months ago
• hvanhovell / weld-java
  JVM integration for Weld
  ☆16Updated 6 years ago
• zrlio / crail
  [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O
  ☆72Updated 6 years ago
• gyfora / StreamKV
  A streaming key-value store implementation using native Flink Streaming operators
  ☆23Updated 9 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• ibm-research-ireland / sparkoscope
  Enabling Spark Optimization through Cross-stack Monitoring and Visualization
  ☆47Updated 7 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• cartershanklin / hive-testbench
  Testbench for experimenting with Apache Hive at any data scale.
  ☆64Updated 7 years ago
• cerndb / Hadoop-Profiler
  Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.
  ☆24Updated 8 years ago
• spirom / spark-data-sources
  Developing Spark External Data Sources using the V2 API
  ☆46Updated 6 years ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated last month
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated this week
• Teradata / tpcds
  Port of TPC-DS dsdgen to Java
  ☆48Updated 6 months ago