Kinesis Connector for Structured Streaming
☆139Jul 2, 2024Updated last year
Alternatives and similar repositories for kinesis-sql
Users that are interested in kinesis-sql are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 5 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).☆18Apr 20, 2024Updated 2 years ago
- ☆23Oct 3, 2024Updated last year
- Google BigQuery data source for Apache Spark☆17Oct 1, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Hadoop output committers for S3☆114Jul 9, 2020Updated 5 years ago
- AWS Athena data source for Apache Spark☆24Sep 1, 2017Updated 8 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆97Jul 7, 2021Updated 4 years ago
- DynamoDB data source for Apache Spark☆95Sep 2, 2021Updated 4 years ago
- Kubernetes Helm Chart to deploy Apache Atlas☆16Oct 19, 2020Updated 5 years ago
- Experiments produced during an end of studies project (ETS, H2018)☆14Nov 21, 2018Updated 7 years ago
- A pyspark lib to validate data quality☆19Nov 11, 2022Updated 3 years ago
- Atomic Scala Book Solutions - for Beginners and first time Functional Programmers☆12Mar 10, 2020Updated 6 years ago
- To describe some typical ways of provisioning Kubernetes clusters for development☆30May 13, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Sep 27, 2016Updated 9 years ago
- Speak Slack notifications and process Slack slash commands☆15Dec 20, 2018Updated 7 years ago
- Base classes to use when writing tests with Spark☆1,553Apr 20, 2026Updated last month
- Python library for Lenses.io / Kafka platform engineers☆19Mar 28, 2024Updated 2 years ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆230May 18, 2026Updated 3 weeks ago
- This is a fork of the Apache Flink Kinesis connector adding Enhanced Fanout support for Flink 1.8/1.11 on KDA.☆24Mar 1, 2026Updated 3 months ago
- Plug-and-play implementation of an Apache Spark custom data source for AWS DynamoDB.☆173Mar 6, 2021Updated 5 years ago
- Yet-Another-Rules-Engine -- A easy-to-understand Business Readable DSL for defining production rules.☆14Mar 24, 2021Updated 5 years ago
- A Spark library for Amazon SageMaker.☆300Mar 8, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An Apache Spark Structured Streaming S3 connector for reading S3 files using Amazon S3 event notifications to AWS SQS☆15Feb 13, 2024Updated 2 years ago
- an impala client for ruby☆34Jan 25, 2017Updated 9 years ago
- Utilities for writing tests that use Apache Spark.☆24Dec 29, 2018Updated 7 years ago
- Implementations of open source Apache Hadoop/Hive interfaces which allow for ingesting data from Amazon DynamoDB☆228Apr 8, 2026Updated 2 months ago
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…☆110Feb 1, 2018Updated 8 years ago
- Provides canary based prewarming of lambda functions for Kinesis Event Sources.☆15Oct 13, 2020Updated 5 years ago
- Learning Elastic Stack 6, published by Packt☆34Jan 30, 2023Updated 3 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Feb 13, 2020Updated 6 years ago
- Multi-stage, config driven, SQL based ETL framework using PySpark☆26Sep 16, 2019Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☕⛵WIP PySpark dependency management☆22Jul 8, 2018Updated 7 years ago
- kinesis-kafka-connector is connector based on Kafka Connect to publish messages to Amazon Kinesis streams or Amazon Kinesis Firehose.☆160Nov 21, 2023Updated 2 years ago
- Essential Spark extensions and helper methods ✨😲☆768Sep 14, 2025Updated 9 months ago
- Test for SparkSQL ScalaPB☆14Jun 28, 2022Updated 3 years ago
- Easy CPU Profiling for Apache Spark applications☆49Dec 17, 2025Updated 5 months ago
- Docker images for Snowplow, Iglu and associated projects☆61Jun 4, 2021Updated 5 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Oct 30, 2018Updated 7 years ago