A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).
☆18Apr 20, 2024Updated last year
Alternatives and similar repositories for s3-sqs-connector
Users that are interested in s3-sqs-connector are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 5 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- Auto extract key in log files☆21Jul 5, 2018Updated 7 years ago
- Log4j appender with S3, Azure, Google Cloud, and search publishing☆68Mar 2, 2026Updated 3 weeks ago
- ☆13Aug 14, 2025Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Spark history server Helm Chart☆22Mar 19, 2024Updated 2 years ago
- Kinesis Connector for Structured Streaming☆139Jul 2, 2024Updated last year
- A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.☆52Sep 17, 2025Updated 6 months ago
- Sensible, minimal simple options parsing and dispatching for Ruby. Build a CLI with no fuss.☆108Feb 29, 2020Updated 6 years ago
- An open-source Software-as-a-Service platform built with the power of Docker☆41May 22, 2019Updated 6 years ago
- Apply YARA rules to your Cutter projects.☆16Jan 7, 2020Updated 6 years ago
- A library for Amazon Neptune that enables AWS Signature Version 4 signing for HTTP using Netty.☆17Oct 21, 2025Updated 5 months ago
- A project that implements statistical methods for identifying anomalous files☆22Dec 10, 2014Updated 11 years ago
- Splunk app for archive management, including HDFS support.☆36Sep 3, 2014Updated 11 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Hyperminimal WSGI framework☆25Dec 16, 2011Updated 14 years ago
- Bε tree implementation☆13Dec 6, 2023Updated 2 years ago
- Adaptive File Source Connector for Spark, optimised for reading from object stores☆15Oct 18, 2022Updated 3 years ago
- Avro Schema Registry (mostly) compatible with salsify/avro-schema-registry☆20Apr 29, 2025Updated 11 months ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Sep 20, 2019Updated 6 years ago
- pure python libprocess implementation☆24Aug 14, 2023Updated 2 years ago
- A Mesos Framework for Tachyon, a memory-centric distributed file system.☆32Aug 25, 2014Updated 11 years ago
- An Apache Spark Structured Streaming S3 connector for reading S3 files using Amazon S3 event notifications to AWS SQS☆15Feb 13, 2024Updated 2 years ago
- Dockerfile for the Packetbeat agent☆30Aug 24, 2015Updated 10 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆47Dec 15, 2023Updated 2 years ago
- iDevice custom ramdisk toolkit☆27May 14, 2022Updated 3 years ago
- A Terraform module to create an Amazon Web Services (AWS) Elastic MapReduce (EMR) cluster.☆39Oct 21, 2019Updated 6 years ago
- A distributed key-value cache with builtin materialized views.☆25Nov 14, 2014Updated 11 years ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Jan 11, 2018Updated 8 years ago
- JWT authentication middleware for Axum☆22Jan 25, 2026Updated 2 months ago
- Puppet-based installer for Katello☆16Jul 29, 2019Updated 6 years ago
- Bootstraps Sinatra with EM-Synchrony code, make TCPSocket EM-aware, provides support for tests☆28May 2, 2011Updated 14 years ago
- Offline Elasticsearch index generator☆26Apr 29, 2021Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Meeting notes☆14Apr 5, 2016Updated 9 years ago
- Gremlin-Python tutorial☆14Nov 15, 2024Updated last year
- ☆30May 5, 2014Updated 11 years ago
- A web-ui for the Packetbeat application monitoring system.☆25Feb 9, 2015Updated 11 years ago
- ☆18Feb 27, 2020Updated 6 years ago
- The Clutch VS code extension allows any user to scan for secrets in his/hers open workspace automatically within the IDE☆17Sep 24, 2025Updated 6 months ago
- Pronounced (influxdb eye-ox), short for iron oxide. This is the new core of InfluxDB written in Rust on top of Apache Arrow.☆15Jun 18, 2024Updated last year