Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.
☆15Sep 6, 2013Updated 12 years ago
Alternatives and similar repositories for kafka-s3-consumer
Users that are interested in kafka-s3-consumer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An executable that polls S3 for added files, and runs a COPY command in Amazon Redshift for the new file.☆17May 24, 2013Updated 13 years ago
- Liquibase support for Redshift☆17Aug 10, 2026Updated last week
- Utility to tail a file and push each new line into a kafka topic☆17Jun 19, 2014Updated 12 years ago
- nginx interface for push message to kafka☆16Oct 27, 2014Updated 11 years ago
- An inspection and administration interface for Go programs, especially Go programs which run on GoCircuit.☆33Apr 27, 2015Updated 11 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- go linter that disallows usage of untyped literals and constants as time.Duration☆13Mar 19, 2023Updated 3 years ago
- Opinionated NSQ producer and consumer interfaces for Go☆19Mar 14, 2016Updated 10 years ago
- A webapp listing Sublime Text packages powered by node, elasticsearch & angularjs☆19Aug 11, 2013Updated 13 years ago
- Tail a log file and send log lines automatically to a kafka topic☆19Jun 8, 2015Updated 11 years ago
- Pure and light binary records☆23May 20, 2014Updated 12 years ago
- Scripting to create a CentOS RPM for Kafka.☆21Nov 25, 2015Updated 10 years ago
- This will serve as set of docker images that should enable running mesos on CoreOS☆63Aug 15, 2014Updated 12 years ago
- Scripts for running Apache Kafka on Mesosphere's Marathon☆14Dec 6, 2015Updated 10 years ago
- In-memory grouping, summarization, pivoting, cross-tabulation etc. of datasets☆15Apr 30, 2012Updated 14 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Circuit Breaker / Rate Limiter☆27Mar 9, 2013Updated 13 years ago
- Ansi C Redis .rdb dump file analyzer☆24Oct 8, 2012Updated 13 years ago
- Ruby bindings for librrd. Extracted from the RRDtool source.☆18Oct 19, 2013Updated 12 years ago
- Go wrapper around os.Getenv() that returns an error instead of empty string☆21May 18, 2015Updated 11 years ago
- Rack middleware to track throughput and response time with metriks☆26Jun 14, 2013Updated 13 years ago
- A Hive Deserializer for CloudFront access logs (supports download distribution files only)☆17Aug 7, 2012Updated 14 years ago
- A simple-build-tool plugin for compiling CoffeeScript files using JCoffeeScript☆20Jan 8, 2011Updated 15 years ago
- Deprecated, use https://github.com/mozilla-services/iprepd☆15May 18, 2018Updated 8 years ago
- See Twitter's emotional state, in real-time☆29Feb 4, 2010Updated 16 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A set of utilities to handle Redis .rdb files with Ruby.☆36Apr 5, 2018Updated 8 years ago
- A very simple proxy handler for gin-gonic☆12Feb 3, 2016Updated 10 years ago
- Generate Redshift schemas from sample objects☆21Apr 25, 2014Updated 12 years ago
- JRuby plugin for flume (jRubySource, jRubySink, jRubyDecorator).☆17Mar 18, 2011Updated 15 years ago
- Churros is a Javascript library for sycing a local HTML 5 Web SQL Database with your server's database.☆13Feb 27, 2011Updated 15 years ago
- Concurrent inverse Bloom filter.☆15Feb 3, 2015Updated 11 years ago
- `which` for open files☆15Jan 23, 2013Updated 13 years ago
- experimental PostgreSQL data type with encryption off-loaded to a trusted component☆18Nov 23, 2018Updated 7 years ago
- Load testing for event analytics platforms (Snowplow, more coming soon)☆13May 17, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Statsd middleware for reporting on requests.☆17Mar 17, 2015Updated 11 years ago
- Run go programs as a service on major platforms.☆16Aug 11, 2015Updated 11 years ago
- MongoDB ORM for Node.js☆35Aug 23, 2012Updated 13 years ago
- Datomic Peer Buildpack & Service☆13Jan 5, 2016Updated 10 years ago
- counters and logarithmically bucketed histograms for distributed systems☆85Sep 3, 2017Updated 8 years ago
- Easy to use CFNetwork wrapper for HTTP requests, Objective-C, Mac OS X and iPhone☆15Jun 19, 2010Updated 16 years ago
- Drop in sharing features for all iPhone and iPad apps☆11Nov 6, 2012Updated 13 years ago