assafmendelson / DataSourceV2

Related projects ⓘ

Alternatives and complementary repositories for DataSourceV2

• squito / spark-memory
  A tool to get better debug info on spark's memory usage
  ☆42Updated 5 years ago
• spirom / spark-data-sources
  Developing Spark External Data Sources using the V2 API
  ☆46Updated 6 years ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• pluralsight / hydra-spark
  ☆50Updated 4 years ago
• lightcopy / parquet-index
  Spark SQL index for Parquet tables
  ☆133Updated 3 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆39Updated 2 years ago
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆93Updated 2 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• hortonworks-spark / spark-hive-streaming-sink
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆23Updated 6 years ago
• metamx / druid-spark-batch
  Druid indexing plugin for using Spark in batch jobs
  ☆101Updated 3 years ago
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 3 years ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆16Updated 4 years ago
• bluejoe2008 / spark-http-stream
  spark structured streaming via HTTP communication
  ☆18Updated 2 years ago
• ibm-research-ireland / sparkoscope
  Enabling Spark Optimization through Cross-stack Monitoring and Visualization
  ☆47Updated 7 years ago
• groupon / spark-metrics
  A library to expose more of Apache Spark's metrics system
  ☆146Updated 4 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 2 weeks ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• streaming-analytics / Styx
  Streaming Analytics platform, built with Apache Flink and Kafka
  ☆34Updated last year
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆85Updated 7 months ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 3 years ago
• ExpediaGroup / jasvorno
  A library for strong, schema based conversion between 'natural' JSON documents and Avro
  ☆18Updated 8 months ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 5 years ago
• bomeng / Heracles
  High performance HBase / Spark SQL engine
  ☆28Updated 2 years ago
• FelixNeutatz / parquet-flinktacular
  How to use Parquet in Flink
  ☆32Updated 7 years ago
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 8 years ago
• king / bravo
  Utilities for processing Flink checkpoints/savepoints
  ☆73Updated 4 years ago
• dataArtisans / flink-training-web
  Apache Flink™ training material website
  ☆79Updated 4 years ago
• qubole / streaminglens
  Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines
  ☆17Updated 4 years ago