A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).
☆19Apr 20, 2024Updated 2 years ago
Alternatives and similar repositories for s3-sqs-connector
Users that are interested in s3-sqs-connector are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An Apache Spark Structured Streaming S3 connector for reading S3 files using Amazon S3 event notifications to AWS SQS☆16Oct 13, 2026Updated 2 weeks ago
- (Original: code.google.com/p/pylinda) A Linda implementation in Python.☆14Jun 16, 2022Updated 4 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 6 years ago
- Kinesis Connector for Structured Streaming☆139Jul 2, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.☆52Sep 17, 2025Updated last year
- Write data to files split by topic and rolled over on size or a timeout, files can be compressed using lzo, snappy or gzip☆11Jul 12, 2021Updated 5 years ago
- Flink HTTP Sink Connector☆11Apr 19, 2021Updated 5 years ago
- Log4j appender with S3, Azure, Google Cloud, and search publishing☆70Oct 10, 2026Updated 2 weeks ago
- Spark history server Helm Chart☆22Mar 19, 2024Updated 2 years ago
- Ultra fast "correct" static context-aware parsing SAS code lexer.☆11Dec 30, 2025Updated 9 months ago
- Adapter board to allow use of a DS1744WP to replace the discontinued DS1742W. Intended for use in the Tektronix TDS3000 series oscillosco…☆11Dec 12, 2019Updated 6 years ago
- A hybrid of Jekyll and Rails.☆12Oct 9, 2015Updated 11 years ago
- Simple test of using Vert.x and React for server-side rendering☆12Mar 9, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Useful extensions to Scala's Iterator☆12Mar 5, 2024Updated 2 years ago
- Generate Pydantic classes from rust☆10Feb 17, 2025Updated last year
- Portable mirc 7.57 + invision. If you have any feature requests, please post in issues!☆14Mar 3, 2020Updated 6 years ago
- Type class based library to read / write XML☆16Jul 1, 2020Updated 6 years ago
- Visualize your CRITs IOC's in Maltego☆12Jan 13, 2015Updated 11 years ago
- Apply YARA rules to your Cutter projects.☆17Jan 7, 2020Updated 6 years ago
- ☆15Jun 26, 2018Updated 8 years ago
- The admin user interface for CrateDB.☆27Aug 6, 2026Updated 2 months ago
- 🚚 ETL for Spark and Airflow☆25Mar 19, 2018Updated 8 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A Scala version of my `sbtmkdirs` shell script☆11Feb 27, 2021Updated 5 years ago
- Create a Kindle dictionary from dict.cc data (specifically Norwegian/Bokmål 🇳🇴 -> German 🇩🇪).☆11Oct 31, 2018Updated 7 years ago
- GitHub Action for Continuous Profiling which you can run to profile your CI/CD. It uses parca and Polar Signals cloud.☆15Oct 2, 2026Updated 3 weeks ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 3 years ago
- ☆11Oct 9, 2026Updated 2 weeks ago
- Binary Search Tree Monad☆12May 8, 2017Updated 9 years ago
- PST File Format SDK (pstsdk) is a cross platform header only C++ library for reading PST files.☆16Jul 22, 2018Updated 8 years ago
- Israeli companies working with Rust☆10Sep 18, 2022Updated 4 years ago
- Retro LOGO with a modern twist. Built with Rust+WASM 🦀☆13Jan 8, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Erpnext docker iamge☆17Jan 11, 2016Updated 10 years ago
- Spark to Tableau Extractor library☆19Oct 23, 2017Updated 9 years ago
- A Terraform module to create an Amazon Web Services (AWS) Elastic MapReduce (EMR) cluster.☆39Oct 21, 2019Updated 7 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Sep 20, 2019Updated 7 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆48Dec 15, 2023Updated 2 years ago
- Maltego tranforms for mapping Honeypot systems.☆15Dec 15, 2014Updated 11 years ago
- ServiceFramework 示例项目☆10Apr 2, 2016Updated 10 years ago