Spark Structured Streaming State Tools
☆35Jul 3, 2020Updated 6 years ago
Alternatives and similar repositories for spark-state-tools
Users that are interested in spark-state-tools are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Custom state store providers for Apache Spark☆92Feb 14, 2025Updated last year
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 5 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23May 7, 2018Updated 8 years ago
- Mirror of Apache Horn (Incubating) ** This project has been retired **☆28Apr 28, 2017Updated 9 years ago
- Kafka offset committer for structured streaming query☆41Feb 15, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Paper: A Zero-rename committer for object stores☆20Nov 7, 2025Updated 9 months ago
- Query Plan Markup Language☆45Jan 18, 2024Updated 2 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- Task Metrics Explorer☆14Apr 2, 2019Updated 7 years ago
- Deriving Spark DataFrame schemas from case classes☆44Jun 24, 2024Updated 2 years ago
- Spark Structured Streaming Kafka 0.8 Source Implementation☆35Apr 27, 2017Updated 9 years ago
- Apache Spark Website☆140Aug 5, 2026Updated last week
- Java OutOfMemory Example☆11Jun 19, 2021Updated 5 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆202Oct 20, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Reporting Apache Spark metrics to Elasticsearch☆13Aug 11, 2016Updated 10 years ago
- An Android app for ClojureDocs☆14Jan 27, 2012Updated 14 years ago
- Spark cloud integration: tests, cloud committers and more☆20Jan 30, 2025Updated last year
- dynamically parse protobuf message then convert to avro☆25May 27, 2015Updated 11 years ago
- The Internals of Spark Structured Streaming☆420Mar 3, 2026Updated 5 months ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Jan 11, 2018Updated 8 years ago
- ☆15Apr 23, 2025Updated last year
- ☆10Jul 5, 2016Updated 10 years ago
- A spark package for loading Spark ML models to Redis-ML☆62Jun 22, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A set of widgets for Python's Orange Machine Learning to work with Apache Spark ML☆15Dec 24, 2016Updated 9 years ago
- Mirror of Apache livy (Incubating)☆13Feb 8, 2024Updated 2 years ago
- Spark on Kubernetes infrastructure Docker images repo☆37Oct 20, 2022Updated 3 years ago
- Swimlane graphs for Hive, SparkSQL, and Presto based on Ganglia resource graphs☆13Feb 13, 2017Updated 9 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆97Jul 7, 2021Updated 5 years ago
- Extensible streaming ingestion pipeline on top of Apache Spark☆47Jul 17, 2025Updated last year
- Visualize column-level data lineage in Spark SQL☆92May 13, 2022Updated 4 years ago
- An example of building kubernetes operator (Flink) using Abstract operator's framework☆26Jul 12, 2019Updated 7 years ago
- Recipes and examples for Apache Spark☆13Jan 21, 2015Updated 11 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Flink Examples☆39Apr 27, 2016Updated 10 years ago
- Spark history server Helm Chart☆22Mar 19, 2024Updated 2 years ago
- The Internals of Delta Lake☆186Jun 18, 2026Updated last month
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆64Sep 6, 2024Updated last year
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- Sample demonstrating consuming Amazon Cognito Streams☆10Jun 15, 2020Updated 6 years ago
- Databricks CI/CD using Azure DevOps☆21Nov 1, 2022Updated 3 years ago