Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.
☆15Sep 6, 2013Updated 13 years ago
Alternatives and similar repositories for kafka-s3-consumer
Users that are interested in kafka-s3-consumer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An executable that polls S3 for added files, and runs a COPY command in Amazon Redshift for the new file.☆17May 24, 2013Updated 13 years ago
- Example RedStorm topologies and specs☆10Jul 25, 2014Updated 12 years ago
- package tenten implements john graham-cumming's 10:10 code for encoding global locations in go☆14Oct 6, 2014Updated 12 years ago
- go linter that disallows usage of untyped literals and constants as time.Duration☆13Mar 19, 2023Updated 3 years ago
- An inspection and administration interface for Go programs, especially Go programs which run on GoCircuit.☆33Apr 27, 2015Updated 11 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Utility to tail a file and push each new line into a kafka topic☆17Jun 19, 2014Updated 12 years ago
- Utility library that integrates the Amazon SQS and SNS offering with the Dropwizard REST framework.☆15Dec 1, 2019Updated 6 years ago
- Liquibase support for Redshift☆17Updated this week
- Opinionated NSQ producer and consumer interfaces for Go☆19Mar 14, 2016Updated 10 years ago
- Tail a log file and send log lines automatically to a kafka topic☆19Jun 8, 2015Updated 11 years ago
- A webapp listing Sublime Text packages powered by node, elasticsearch & angularjs☆19Aug 11, 2013Updated 13 years ago
- ZeroMQ Enterprise Publish-Subscribe (ZEPS) **DEPRECATED**☆12Apr 25, 2015Updated 11 years ago
- In-memory grouping, summarization, pivoting, cross-tabulation etc. of datasets☆15Apr 30, 2012Updated 14 years ago
- go library for transparently writing to and reading from different types of paths (supports stdout, s3, and fs)☆15Nov 5, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Circuit Breaker / Rate Limiter☆26Mar 9, 2013Updated 13 years ago
- Non-blocking Goliath webservice to convert images to ascii☆35Sep 18, 2011Updated 15 years ago
- Ansi C Redis .rdb dump file analyzer☆24Oct 8, 2012Updated 14 years ago
- Ruby bindings for librrd. Extracted from the RRDtool source.☆18Oct 19, 2013Updated 13 years ago
- Native Ruby bindings to Hadoop's libhdfs, for interacting with Hadoop DFS.☆16May 27, 2015Updated 11 years ago
- Rack middleware to track throughput and response time with metriks☆26Jun 14, 2013Updated 13 years ago
- A simple-build-tool plugin for compiling CoffeeScript files using JCoffeeScript☆20Jan 8, 2011Updated 15 years ago
- Exactly what it says on the tin.☆20Oct 10, 2017Updated 9 years ago
- A Hive Deserializer for CloudFront access logs (supports download distribution files only)☆17Aug 7, 2012Updated 14 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Agent-based F# library for collecting, aggregating and publishing metrics (e.g. to Amazon CloudWatch)☆12Jun 12, 2015Updated 11 years ago
- See Twitter's emotional state, in real-time☆28Feb 4, 2010Updated 16 years ago
- A very simple proxy handler for gin-gonic☆12Feb 3, 2016Updated 10 years ago
- Crazy experimental HTTP-over-RSPDY router☆12Oct 12, 2013Updated 13 years ago
- A standalone service discover and load balancer module for dropwizard☆13Oct 6, 2014Updated 12 years ago
- Automatic module reloader for Elixir☆13Mar 27, 2014Updated 12 years ago
- A clojure library for Librato Metrics☆12Jul 13, 2015Updated 11 years ago
- Deprecated, use https://github.com/mozilla-services/iprepd☆15May 18, 2018Updated 8 years ago
- Monitors users interactions with your rails application☆12Nov 4, 2009Updated 17 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Store your configuration in DynamoDB☆11May 25, 2018Updated 8 years ago
- pipe stdout to a redis pubsub channel☆13Aug 9, 2013Updated 13 years ago
- (No longer supported) Heroku buildpack for running multiple buildpacks in sequence and combining the results☆11Apr 19, 2014Updated 12 years ago
- VM based development environment for OpenStack and SmartOS☆10Oct 2, 2012Updated 14 years ago
- My little fork of http://hackmysql.com/mysqlsniffer☆10Oct 4, 2012Updated 14 years ago
- Package sevenzip implements access to 7-zip archives (wraps C interface of LZMA SDK)☆11Oct 24, 2012Updated 14 years ago
- Statsd middleware for reporting on requests.☆17Mar 17, 2015Updated 11 years ago