awslabs / amazon-kinesis-scaling-utils
The Kinesis Scaling Utility is designed to give you the ability to scale Amazon Kinesis Streams in the same way that you scale EC2 Auto Scaling groups – up or down by a count or as a percentage of the total fleet. You can also simply scale to an exact number of Shards. There is no requirement for you to manage the allocation of the keyspace to S…
☆336Updated last year
Alternatives and similar repositories for amazon-kinesis-scaling-utils:
Users that are interested in amazon-kinesis-scaling-utils are comparing it to the libraries listed below
- AWS Lambda function to forward Stream data to Kinesis Firehose☆278Updated last year
- AWS libraries/modules for working with Kinesis aggregated record data☆377Updated 7 months ago
- ☆326Updated 4 years ago
- A library to facilitate cross-region replication with Amazon DynamoDB Streams.☆275Updated 4 years ago
- A sample AWS Lambda function that accepts messages from an Amazon Kinesis Stream and transfers the messages to another data transport.☆289Updated 2 years ago
- Dynamic DynamoDB provides auto scaling for AWS DynamoDB☆618Updated 4 years ago
- Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.☆150Updated 4 years ago
- Amazon Redshift Database Loader implemented in AWS Lambda☆595Updated 9 months ago
- Continuous backup automation for Amazon DynamoDB☆183Updated 2 years ago
- Amazon Kinesis Producer Library☆409Updated this week
- Exports DynamoDB items via parallel scan into a blocking queue, then consumes the queue and import DynamoDB items into a replica table us…☆90Updated 5 years ago
- A specialized Amazon Kinesis stream reader (based on the Amazon Kinesis Connector Library) that can help you deliver data from Amazon Clo…☆399Updated 7 years ago
- Implementations of open source Apache Hadoop/Hive interfaces which allow for ingesting data from Amazon DynamoDB☆224Updated this week
- This input plugin for Logstash scans a specified DynamoDB table and then reads changes to a DynamoDB table from the associated DynamoDB S…☆106Updated 3 years ago
- Autoscale DynamoDB provisioned capacity using Lambda☆312Updated 7 years ago
- Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.☆369Updated 2 months ago
- This repository hosts sample pipelines☆466Updated 5 years ago
- The Amazon DynamoDB Streams Adapter implements the Amazon Kinesis interface so that your application can use KCL to consume and process d…☆99Updated 6 months ago
- Amazon Kinesis output plugin for Fluentd☆292Updated last year
- An implementation of Amazon's Kinesis built on LevelDB☆812Updated last year
- Client library for Amazon Kinesis☆649Updated 3 weeks ago
- Data ingestion for Amazon Elasticsearch Service from S3 and Amazon Kinesis, using AWS Lambda: Sample code☆390Updated 6 years ago
- This repo presents a reference architecture for running serverless MapReduce jobs. This has been implemented using AWS Lambda and Amazon …☆427Updated last year
- Stream DynamoDB backups to S3☆142Updated last year
- ☆357Updated 4 years ago
- This example code illustrates how to extend AWS Lambda functionality using Amazon SQS and the Amazon EC2 Container Service (ECS).☆291Updated 7 years ago
- Amazon Kinesis Client Library for Python☆373Updated 2 weeks ago
- module for dynamodb multi-region replication☆128Updated last year
- Amazon Redshift Advanced Monitoring☆272Updated 2 years ago
- A set of Custom Resources that enables API Gateway support for CloudFormation☆91Updated 5 years ago