Intel-bigdata / Spark-PMoF

Related projects ⓘ

Alternatives and complementary repositories for Spark-PMoF

• apache / incubator-crail
  Mirror of Apache crail (Incubating)
  ☆148Updated 2 years ago
• MemVerge / splash
  Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
  ☆127Updated last month
• zrlio / crail-spark-io
  Fast I/O plugins for Spark
  ☆41Updated 3 years ago
• maropu / spark-tpcds-datagen
  All the things about TPC-DS in Apache Spark
  ☆104Updated last year
• zrlio / albis
  Albis: High-Performance File Format for Big Data Systems
  ☆21Updated 6 years ago
• openucx / sparkucx
  A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
  ☆46Updated last year
• oap-project / remote-shuffle
  Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…
  ☆21Updated 8 months ago
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated last year
• Mellanox / SparkRDMA
  This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvid…
  ☆241Updated 5 years ago
• zrlio / crail
  [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O
  ☆71Updated 6 years ago
• ehiggs / spark-terasort
  Spark Terasort
  ☆123Updated last year
• IBM / spark-tpc-ds-performance-test
  Use the TPC-DS benchmark to test Spark SQL performance
  ☆175Updated 4 years ago
• oap-project / pmem-shuffle
  Spark* Shuffle plugin for support shuffling through remote persistent memory over fabrics, which leverages the RDMA network and remote pe…
  ☆14Updated last year
• substrait-io / substrait-java
  ☆77Updated this week
• asonje / PAT
  Performance Analysis Tool
  ☆76Updated last year
• oap-project / gazelle_plugin
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆256Updated last year
• apache / phoenix-omid
  Mirror of Apache Omid Incubator
  ☆87Updated last week
• dataArtisans / yahoo-streaming-benchmark
  An extension of Yahoo's Benchmarks
  ☆106Updated 11 months ago
• rtahboub / spark-sql-customized-parser
  An experiment to inject a customized parser using SparkSessionExtension
  ☆17Updated 6 years ago
• zrlio / disni
  DiSNI: Direct Storage and Networking Interface
  ☆186Updated last year
• ssavvides / tpch-spark
  TPC-H queries in Apache Spark SQL using native DataFrames API
  ☆98Updated 9 months ago
• ververica / frocksdb
  ☆63Updated 3 months ago
• lhbench / lhbench
  Lakehouse storage system benchmark
  ☆66Updated last year
• squito / spark-memory
  A tool to get better debug info on spark's memory usage
  ☆42Updated 5 years ago
• strymon-system / ds2
  DS2 is an auto-scaling controller for distributed streaming dataflows
  ☆88Updated last year