awslabs / amazon-kinesis-scaling-utils
The Kinesis Scaling Utility is designed to give you the ability to scale Amazon Kinesis Streams in the same way that you scale EC2 Auto Scaling groups – up or down by a count or as a percentage of the total fleet. You can also simply scale to an exact number of Shards. There is no requirement for you to manage the allocation of the keyspace to S…
☆336Updated last year
Alternatives and similar repositories for amazon-kinesis-scaling-utils:
Users that are interested in amazon-kinesis-scaling-utils are comparing it to the libraries listed below
- AWS Lambda function to forward Stream data to Kinesis Firehose☆278Updated last year
- A library to facilitate cross-region replication with Amazon DynamoDB Streams.☆276Updated 4 years ago
- Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.☆150Updated 3 years ago
- ☆325Updated 4 years ago
- AWS libraries/modules for working with Kinesis aggregated record data☆378Updated 5 months ago
- A sample AWS Lambda function that accepts messages from an Amazon Kinesis Stream and transfers the messages to another data transport.☆289Updated 2 years ago
- Implementations of open source Apache Hadoop/Hive interfaces which allow for ingesting data from Amazon DynamoDB☆221Updated last week
- Amazon Kinesis Producer Library☆404Updated 2 weeks ago
- Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.☆367Updated last month
- Amazon Redshift Database Loader implemented in AWS Lambda☆595Updated 8 months ago
- Continuous backup automation for Amazon DynamoDB☆183Updated 2 years ago
- The Amazon DynamoDB Streams Adapter implements the Amazon Kinesis interface so that your application can use KCL to consume and process d…☆98Updated 5 months ago
- Dynamic DynamoDB provides auto scaling for AWS DynamoDB☆618Updated 3 years ago
- Exports DynamoDB items via parallel scan into a blocking queue, then consumes the queue and import DynamoDB items into a replica table us…☆90Updated 5 years ago
- Data ingestion for Amazon Elasticsearch Service from S3 and Amazon Kinesis, using AWS Lambda: Sample code☆390Updated 5 years ago
- Amazon Kinesis output plugin for Fluentd☆293Updated 11 months ago
- ☆357Updated 4 years ago
- A specialized Amazon Kinesis stream reader (based on the Amazon Kinesis Connector Library) that can help you deliver data from Amazon Clo…☆399Updated 6 years ago
- An implementation of Amazon's Kinesis built on LevelDB☆810Updated 10 months ago
- Autoscale DynamoDB provisioned capacity using Lambda☆312Updated 7 years ago
- This example code illustrates how to extend AWS Lambda functionality using Amazon SQS and the Amazon EC2 Container Service (ECS).☆290Updated 7 years ago
- Stream DynamoDB backups to S3☆142Updated last year
- Client library for Amazon Kinesis☆643Updated this week
- Logstash output plugin to sign and export logstash events to Amazon Elasticsearch Service☆375Updated 2 years ago
- This input plugin for Logstash scans a specified DynamoDB table and then reads changes to a DynamoDB table from the associated DynamoDB S…☆106Updated 3 years ago
- AWS ElasticSearch Kibana Proxy☆320Updated last year
- module for dynamodb multi-region replication☆128Updated 10 months ago
- This repository hosts sample pipelines☆466Updated 4 years ago
- This repo presents a reference architecture for running serverless MapReduce jobs. This has been implemented using AWS Lambda and Amazon …☆427Updated last year
- A set of Custom Resources that enables API Gateway support for CloudFormation☆91Updated 5 years ago