awslabs / amazon-kinesis-scaling-utils
The Kinesis Scaling Utility is designed to give you the ability to scale Amazon Kinesis Streams in the same way that you scale EC2 Auto Scaling groups – up or down by a count or as a percentage of the total fleet. You can also simply scale to an exact number of Shards. There is no requirement for you to manage the allocation of the keyspace to S…
☆337Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for amazon-kinesis-scaling-utils
- AWS Lambda function to forward Stream data to Kinesis Firehose☆279Updated last year
- AWS libraries/modules for working with Kinesis aggregated record data☆378Updated last month
- Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.☆151Updated 3 years ago
- A library to facilitate cross-region replication with Amazon DynamoDB Streams.☆275Updated 4 years ago
- ☆326Updated 3 years ago
- A sample AWS Lambda function that accepts messages from an Amazon Kinesis Stream and transfers the messages to another data transport.☆288Updated 2 years ago
- Amazon Redshift Database Loader implemented in AWS Lambda☆597Updated 4 months ago
- Amazon Kinesis Producer Library☆401Updated last week
- Implementations of open source Apache Hadoop/Hive interfaces which allow for ingesting data from Amazon DynamoDB☆217Updated 2 weeks ago
- Dynamic DynamoDB provides auto scaling for AWS DynamoDB☆618Updated 3 years ago
- Continuous backup automation for Amazon DynamoDB☆185Updated 2 years ago
- Exports DynamoDB items via parallel scan into a blocking queue, then consumes the queue and import DynamoDB items into a replica table us…☆90Updated 5 years ago
- The Amazon DynamoDB Streams Adapter implements the Amazon Kinesis interface so that your application can use KCL to consume and process d…☆99Updated last month
- Amazon Kinesis output plugin for Fluentd☆293Updated 7 months ago
- This input plugin for Logstash scans a specified DynamoDB table and then reads changes to a DynamoDB table from the associated DynamoDB S…☆105Updated 2 years ago
- Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.☆360Updated last week
- A specialized Amazon Kinesis stream reader (based on the Amazon Kinesis Connector Library) that can help you deliver data from Amazon Clo…☆397Updated 6 years ago
- Client library for Amazon Kinesis☆644Updated this week
- Data ingestion for Amazon Elasticsearch Service from S3 and Amazon Kinesis, using AWS Lambda: Sample code☆391Updated 5 years ago
- An implementation of Amazon's Kinesis built on LevelDB☆810Updated 6 months ago
- Autoscale DynamoDB provisioned capacity using Lambda☆313Updated 7 years ago
- A set of Custom Resources that enables API Gateway support for CloudFormation☆91Updated 5 years ago
- Logstash output plugin to sign and export logstash events to Amazon Elasticsearch Service☆376Updated 2 years ago
- This example code illustrates how to extend AWS Lambda functionality using Amazon SQS and the Amazon EC2 Container Service (ECS).☆290Updated 7 years ago
- This repository hosts sample pipelines☆464Updated 4 years ago
- This repo presents a reference architecture for running serverless MapReduce jobs. This has been implemented using AWS Lambda and Amazon …☆427Updated last year
- ARCHIVED: Service Discovery via DNS with ECS.☆166Updated 6 years ago
- Amazon Kinesis Client Library for Python☆370Updated 2 weeks ago
- ☆357Updated 3 years ago
- Sample code for dynamically managing RDS/RDBMS connections across a fleet of Lambda functions☆234Updated 5 years ago