Rocksdb state storage implementation for Structured Streaming.
☆17Oct 21, 2020Updated 5 years ago
Alternatives and similar repositories for spark-state-store
Users that are interested in spark-state-store are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- Kafka offset committer for structured streaming query☆41Feb 15, 2021Updated 5 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆97Jul 7, 2021Updated 4 years ago
- Albis: High-Performance File Format for Big Data Systems☆21Jul 12, 2018Updated 7 years ago
- Custom state store providers for Apache Spark☆92Feb 14, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Kafka metric sink for Apache Spark☆11Apr 13, 2017Updated 9 years ago
- Real Time Streaming using Apache Spark Streaming [Video], published by Packt☆10Oct 31, 2022Updated 3 years ago
- A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).☆18Apr 20, 2024Updated 2 years ago
- Spark cloud integration: tests, cloud committers and more☆20Jan 30, 2025Updated last year
- ☆20Mar 15, 2024Updated 2 years ago
- A java agent for tracing which can be configured via simple text file and instruments the code without rebuilding the project.☆49Feb 28, 2026Updated 2 months ago
- ☆16Jun 27, 2020Updated 5 years ago
- The Internals of PySpark☆28Dec 29, 2024Updated last year
- Grizzly: Efficient Stream Processing Through Adaptive Query Compilation☆16Jun 13, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆11Oct 11, 2022Updated 3 years ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Mar 2, 2026Updated 2 months ago
- OCEAN – Open-source CXL Emulation at Hyperscale Architecture and Networking.☆27May 13, 2026Updated last week
- ☆14May 28, 2020Updated 5 years ago
- Ingress data from kafka topic into clickhouse table (JSON format)☆24Apr 12, 2018Updated 8 years ago
- Frequently Asked Questions about PyFlink☆24Mar 1, 2023Updated 3 years ago
- Artifact package for CBMM paper (ATC'22)☆11Jun 5, 2022Updated 3 years ago
- spark structured streaming via HTTP communication☆18Jul 7, 2022Updated 3 years ago
- Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …☆13Jun 24, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆14Apr 14, 2023Updated 3 years ago
- Basic Spark utilities☆13Feb 20, 2025Updated last year
- Dynamic and Transparent Memory Sharing for Accelerating Big Data Analytics Workloads in Virtualized Cloud☆16Feb 13, 2017Updated 9 years ago
- A sample custom Spark Structured Streaming Datasource with Websockets☆12May 14, 2020Updated 6 years ago
- A pyspark lib to validate data quality☆19Nov 11, 2022Updated 3 years ago
- Docker images for Exercism tracks☆16Feb 26, 2025Updated last year
- This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark w…☆16Oct 3, 2025Updated 7 months ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆177Apr 23, 2023Updated 3 years ago
- API REST boilerplate using Spring Boot and Redis as database☆13Dec 26, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Streaming Data Simulator☆17Oct 12, 2020Updated 5 years ago
- Tools and experiments for 0sim. Simulate system software behavior on machines with terabytes of main memory from your desktop.☆21May 27, 2020Updated 5 years ago
- Due to lack of resources on how to deploy kafka with simple SASL authentication (just username and password) and how to write producer an…☆12Dec 29, 2021Updated 4 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆96May 11, 2026Updated 2 weeks ago
- Sample Application for Remote Kubernetes Development in Visual Studio Code with Okteto☆11Jan 21, 2022Updated 4 years ago
- Example to create lineage in Atlas with sqoop and spark☆14Apr 5, 2017Updated 9 years ago
- Tools for faster and optimized interaction with Teradata and large datasets.☆17Jul 11, 2018Updated 7 years ago