Rocksdb state storage implementation for Structured Streaming.
☆17Oct 21, 2020Updated 5 years ago
Alternatives and similar repositories for spark-state-store
Users that are interested in spark-state-store are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆96Jul 7, 2021Updated 4 years ago
- Albis: High-Performance File Format for Big Data Systems☆21Jul 12, 2018Updated 7 years ago
- Clickhouse typesafe RowBinary insert tooling☆13Jul 6, 2019Updated 6 years ago
- A Kafka metric sink for Apache Spark☆11Apr 13, 2017Updated 8 years ago
- Spark Structured Streaming State Tools☆34Jul 3, 2020Updated 5 years ago
- Real Time Streaming using Apache Spark Streaming [Video], published by Packt☆10Oct 31, 2022Updated 3 years ago
- Kinesis Connector for Structured Streaming☆139Jul 2, 2024Updated last year
- Benchmarking code for evaluating the cost of cache coherence protocols implemented on different platforms☆14Apr 13, 2021Updated 4 years ago
- ☆20Mar 15, 2024Updated 2 years ago
- ☆16Jun 27, 2020Updated 5 years ago
- Grizzly: Efficient Stream Processing Through Adaptive Query Compilation☆16Jun 13, 2020Updated 5 years ago
- ☆11Oct 11, 2022Updated 3 years ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Mar 2, 2026Updated 3 weeks ago
- OCEAN – Open-source CXL Emulation at Hyperscale Architecture and Networking.☆23Mar 14, 2026Updated last week
- ☆13Mar 29, 2019Updated 6 years ago
- ☆14May 28, 2020Updated 5 years ago
- A typelevel.g8 based on sbt-typelevel☆15Updated this week
- Data validation library for PySpark 3.0.0☆33Nov 11, 2022Updated 3 years ago
- A set of widgets for Python's Orange Machine Learning to work with Apache Spark ML☆15Dec 24, 2016Updated 9 years ago
- Source code for TPCx-BB benchmark for Hive and SparkSQL on scale factor of 300 GB☆10Jun 26, 2018Updated 7 years ago
- Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …☆13Jun 24, 2024Updated last year
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆14Apr 14, 2023Updated 2 years ago
- Dynamic and Transparent Memory Sharing for Accelerating Big Data Analytics Workloads in Virtualized Cloud☆16Feb 13, 2017Updated 9 years ago
- Basic Spark utilities☆13Feb 20, 2025Updated last year
- ☆15Dec 2, 2019Updated 6 years ago
- A sample custom Spark Structured Streaming Datasource with Websockets☆13May 14, 2020Updated 5 years ago
- A pyspark lib to validate data quality☆18Nov 11, 2022Updated 3 years ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆177Apr 23, 2023Updated 2 years ago
- This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark w…☆16Oct 3, 2025Updated 5 months ago
- API REST boilerplate using Spring Boot and Redis as database☆13Dec 26, 2018Updated 7 years ago
- Due to lack of resources on how to deploy kafka with simple SASL authentication (just username and password) and how to write producer an…☆12Dec 29, 2021Updated 4 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆95May 9, 2025Updated 10 months ago
- Sample Application for Remote Kubernetes Development in Visual Studio Code with Okteto☆11Jan 21, 2022Updated 4 years ago
- Example to create lineage in Atlas with sqoop and spark☆14Apr 5, 2017Updated 8 years ago
- query OpenTelemetry metrics, logs, and traces (OTLP) in duckdb☆39Mar 10, 2026Updated 2 weeks ago
- Generate mock data based on an Apache Avro schema and specific cardinality settings☆10Apr 16, 2018Updated 7 years ago
- SQL Server Always Encrypted Key Store Generic Provider for Key Store Interopearibility between Windows and Linux☆11Oct 24, 2018Updated 7 years ago
- Thoughts on things I find interesting.☆17Dec 19, 2024Updated last year