awslabs / lambda-refarch-mapreduce
This repo presents a reference architecture for running serverless MapReduce jobs. This has been implemented using AWS Lambda and Amazon S3.
☆427Updated last year
Related projects ⓘ
Alternatives and complementary repositories for lambda-refarch-mapreduce
- A sample AWS Lambda function that accepts messages from an Amazon Kinesis Stream and transfers the messages to another data transport.☆288Updated 2 years ago
- The Kinesis Scaling Utility is designed to give you the ability to scale Amazon Kinesis Streams in the same way that you scale EC2 Auto S…☆337Updated 11 months ago
- AWS libraries/modules for working with Kinesis aggregated record data☆378Updated last month
- AWS Lambda function to forward Stream data to Kinesis Firehose☆279Updated last year
- This example code illustrates how to extend AWS Lambda functionality using Amazon SQS and the Amazon EC2 Container Service (ECS).☆290Updated 7 years ago
- A library to facilitate cross-region replication with Amazon DynamoDB Streams.☆275Updated 4 years ago
- Amazon Redshift Database Loader implemented in AWS Lambda☆597Updated 4 months ago
- Dynamic DynamoDB provides auto scaling for AWS DynamoDB☆618Updated 3 years ago
- Continuous backup automation for Amazon DynamoDB☆185Updated 2 years ago
- An EC2 Container Service Reference Architecture for providing Service Discovery to containers using CloudWatch Events, Lambda and Route 5…☆445Updated 5 years ago
- Data ingestion for Amazon Elasticsearch Service from S3 and Amazon Kinesis, using AWS Lambda: Sample code☆391Updated 5 years ago
- Autoscale DynamoDB provisioned capacity using Lambda☆313Updated 7 years ago
- This repository hosts sample pipelines☆464Updated 4 years ago
- A specialized Amazon Kinesis stream reader (based on the Amazon Kinesis Connector Library) that can help you deliver data from Amazon Clo…☆397Updated 6 years ago
- An implementation of Amazon's Kinesis built on LevelDB☆810Updated 6 months ago
- This input plugin for Logstash scans a specified DynamoDB table and then reads changes to a DynamoDB table from the associated DynamoDB S…☆105Updated 2 years ago
- Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.☆151Updated 3 years ago
- What precedes Lambda☆902Updated 3 years ago
- Client SDKs for ServerlessNetworking☆80Updated 5 years ago
- Open source tools for building custom schedulers on Amazon ECS☆944Updated 6 years ago
- Run Node in Lambda. Debug from your machine.☆294Updated 2 years ago
- Exports DynamoDB items via parallel scan into a blocking queue, then consumes the queue and import DynamoDB items into a replica table us…☆90Updated 5 years ago
- Material for re:Invent 2016 - CON314 - Workshop: Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot Instances☆192Updated 5 years ago
- Sample code for dynamically managing RDS/RDBMS connections across a fleet of Lambda functions☆234Updated 5 years ago
- Implementations of open source Apache Hadoop/Hive interfaces which allow for ingesting data from Amazon DynamoDB☆217Updated 2 weeks ago
- ☆326Updated 3 years ago
- The AWS Lambda container image converter tool (img2lambda) repackages container images (such as Docker images) into AWS Lambda function d…☆1,323Updated 3 years ago
- Amazon API Gateway sample using Amazon Cognito credentials through AWS Lambda☆307Updated 3 years ago
- A Ruby gem that provides a command-line validator for Amazon States Language JSON files.☆336Updated 4 months ago