A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).
☆18Apr 20, 2024Updated 2 years ago
Alternatives and similar repositories for s3-sqs-connector
Users that are interested in s3-sqs-connector are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark SQS Amazon queue receiver☆24Nov 22, 2021Updated 4 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 5 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- Auto extract key in log files☆21Jul 5, 2018Updated 7 years ago
- Write data to files split by topic and rolled over on size or a timeout, files can be compressed using lzo, snappy or gzip☆11Jul 12, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Log4j appender with S3, Azure, Google Cloud, and search publishing☆69Mar 2, 2026Updated 2 months ago
- React components for Cookies settings panel, cookie banner and redux store for GDPR Compliance websites☆11Sep 14, 2018Updated 7 years ago
- Kinesis Connector for Structured Streaming☆138Jul 2, 2024Updated last year
- A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.☆52Sep 17, 2025Updated 7 months ago
- A library to manage Mach port right references and exchange Mach messages in Rust.☆13May 16, 2023Updated 2 years ago
- Simple test of using Vert.x and React for server-side rendering☆12Mar 9, 2017Updated 9 years ago
- Performance Counters for Apple Silicon on macOS☆20Jan 9, 2022Updated 4 years ago
- Type class based library to read / write XML☆16Jul 1, 2020Updated 5 years ago
- An open-source Software-as-a-Service platform built with the power of Docker☆41May 22, 2019Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A rails plugin to use the .plist format to return binary plists☆40Dec 14, 2012Updated 13 years ago
- ☆15Jun 26, 2018Updated 7 years ago
- Create a Kindle dictionary from dict.cc data (specifically Norwegian/Bokmål 🇳🇴 -> German 🇩🇪).☆11Oct 31, 2018Updated 7 years ago
- Apply YARA rules to your Cutter projects.☆16Jan 7, 2020Updated 6 years ago
- A library for Amazon Neptune that enables AWS Signature Version 4 signing for HTTP using Netty.☆17Oct 21, 2025Updated 6 months ago
- Network timing evaluation used to detect beacons, works with argus flow as the source☆20May 4, 2016Updated 10 years ago
- A project that implements statistical methods for identifying anomalous files☆22Dec 10, 2014Updated 11 years ago
- Inspired by Crunchbase, ShortStack is the CfA database for public software, products and government entities☆14Oct 10, 2011Updated 14 years ago
- A Kubernetes operator to enable GitOps style deploys for Databricks resources☆16Jun 3, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Bε tree implementation☆13Dec 6, 2023Updated 2 years ago
- Adaptive File Source Connector for Spark, optimised for reading from object stores☆15Oct 18, 2022Updated 3 years ago
- Erpnext docker iamge☆17Jan 11, 2016Updated 10 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Sep 20, 2019Updated 6 years ago
- A Mesos Framework for Tachyon, a memory-centric distributed file system.☆33Aug 25, 2014Updated 11 years ago
- An Apache Spark Structured Streaming S3 connector for reading S3 files using Amazon S3 event notifications to AWS SQS☆15Feb 13, 2024Updated 2 years ago
- Runtime code injection suite for exploring OS X process security☆40Jun 1, 2009Updated 16 years ago
- redis session store for rack☆27Jan 3, 2012Updated 14 years ago
- A safe and convenient store for one value of each type☆15Nov 9, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Jan 11, 2018Updated 8 years ago
- JWT authentication middleware for Axum☆22Apr 6, 2026Updated last month
- Kafka Connect Store Partitioner by custom fields and time☆42Dec 8, 2021Updated 4 years ago
- Experimental DataFusion Optimizer☆52Jun 9, 2023Updated 2 years ago
- This one will show various notifications types one over another at the top covering the entire width of the page. Tested on IE, Firefox a…☆15Feb 1, 2011Updated 15 years ago
- Offline Elasticsearch index generator☆26Apr 29, 2021Updated 5 years ago
- Gremlin-Python tutorial☆14Nov 15, 2024Updated last year