Rocksdb state storage implementation for Structured Streaming.
☆17Oct 21, 2020Updated 5 years ago
Alternatives and similar repositories for spark-state-store
Users that are interested in spark-state-store are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Kafka offset committer for structured streaming query☆41Feb 15, 2021Updated 5 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆97Jul 7, 2021Updated 5 years ago
- Custom state store providers for Apache Spark☆92Feb 14, 2025Updated last year
- Albis: High-Performance File Format for Big Data Systems☆21Jul 12, 2018Updated 8 years ago
- Clickhouse typesafe RowBinary insert tooling☆13Jul 6, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Spark Structured Streaming State Tools☆35Jul 3, 2020Updated 6 years ago
- A Kafka metric sink for Apache Spark☆11Apr 13, 2017Updated 9 years ago
- Kinesis Connector for Structured Streaming☆139Jul 2, 2024Updated 2 years ago
- Benchmarking code for evaluating the cost of cache coherence protocols implemented on different platforms☆14Apr 13, 2021Updated 5 years ago
- Spark cloud integration: tests, cloud committers and more☆20Jan 30, 2025Updated last year
- The Internals of PySpark☆28Dec 29, 2024Updated last year
- ☆16Jun 27, 2020Updated 6 years ago
- A java agent for tracing which can be configured via simple text file and instruments the code without rebuilding the project.☆51Jul 12, 2026Updated last month
- ☆20Mar 15, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆12Oct 16, 2023Updated 2 years ago
- ☆11Oct 11, 2022Updated 3 years ago
- Artifact package for CBMM paper (ATC'22)☆11Jun 5, 2022Updated 4 years ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Mar 2, 2026Updated 6 months ago
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆14Apr 14, 2023Updated 3 years ago
- Basic Spark utilities☆13Jul 24, 2026Updated last month
- ☆14May 28, 2020Updated 6 years ago
- Ingress data from kafka topic into clickhouse table (JSON format)☆24Apr 12, 2018Updated 8 years ago
- Source code for TPCx-BB benchmark for Hive and SparkSQL on scale factor of 300 GB☆10Jun 26, 2018Updated 8 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …☆13Jun 24, 2024Updated 2 years ago
- ☆14Mar 29, 2019Updated 7 years ago
- Dynamic and Transparent Memory Sharing for Accelerating Big Data Analytics Workloads in Virtualized Cloud☆16Feb 13, 2017Updated 9 years ago
- A sample custom Spark Structured Streaming Datasource with Websockets☆12May 14, 2020Updated 6 years ago
- API REST boilerplate using Spring Boot and Redis as database☆13Dec 26, 2018Updated 7 years ago
- Streaming Data Simulator☆16Oct 12, 2020Updated 5 years ago
- Thoughts on things I find interesting.☆17Dec 19, 2024Updated last year
- Tools and experiments for 0sim. Simulate system software behavior on machines with terabytes of main memory from your desktop.☆22May 27, 2020Updated 6 years ago
- Example to create lineage in Atlas with sqoop and spark☆14Apr 5, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆180Apr 23, 2023Updated 3 years ago
- Python Korean Lunar Calendar☆16Sep 14, 2015Updated 10 years ago
- Generate mock data based on an Apache Avro schema and specific cardinality settings☆10Apr 16, 2018Updated 8 years ago
- Delta Lake helper methods. No Spark dependency.☆21Jan 19, 2026Updated 7 months ago
- SQL Server Always Encrypted Key Store Generic Provider for Key Store Interopearibility between Windows and Linux☆11Oct 24, 2018Updated 7 years ago
- ☆16Apr 9, 2019Updated 7 years ago
- An experiment to inject a customized parser using SparkSessionExtension☆16Jan 1, 2018Updated 8 years ago