Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.
☆15Sep 6, 2013Updated 13 years ago
Alternatives and similar repositories for kafka-s3-consumer
Users that are interested in kafka-s3-consumer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An executable that polls S3 for added files, and runs a COPY command in Amazon Redshift for the new file.☆17May 24, 2013Updated 13 years ago
- Liquibase support for Redshift☆17Updated this week
- Utility to tail a file and push each new line into a kafka topic☆17Jun 19, 2014Updated 12 years ago
- Static Python Zookeeper Binding☆15Apr 25, 2023Updated 3 years ago
- An inspection and administration interface for Go programs, especially Go programs which run on GoCircuit.☆33Apr 27, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Utility library that integrates the Amazon SQS and SNS offering with the Dropwizard REST framework.☆14Dec 1, 2019Updated 6 years ago
- Files to help make new spark EMR Bootstraps☆15Aug 4, 2013Updated 13 years ago
- Opinionated NSQ producer and consumer interfaces for Go☆19Mar 14, 2016Updated 10 years ago
- Pure and light binary records☆23May 20, 2014Updated 12 years ago
- Scripts for running Apache Kafka on Mesosphere's Marathon☆14Dec 6, 2015Updated 10 years ago
- In-memory grouping, summarization, pivoting, cross-tabulation etc. of datasets☆15Apr 30, 2012Updated 14 years ago
- Non-blocking Goliath webservice to convert images to ascii☆35Sep 18, 2011Updated 14 years ago
- A simple spdy server I wrote.☆15Oct 6, 2013Updated 12 years ago
- Circuit Breaker / Rate Limiter☆27Mar 9, 2013Updated 13 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Ruby bindings for librrd. Extracted from the RRDtool source.☆18Oct 19, 2013Updated 12 years ago
- Native Ruby bindings to Hadoop's libhdfs, for interacting with Hadoop DFS.☆16May 27, 2015Updated 11 years ago
- Go wrapper around os.Getenv() that returns an error instead of empty string☆21May 18, 2015Updated 11 years ago
- Rack middleware to track throughput and response time with metriks☆26Jun 14, 2013Updated 13 years ago
- levigo is a Go wrapper for LevelDB☆19Jan 30, 2014Updated 12 years ago
- Deprecated, use https://github.com/mozilla-services/iprepd☆15May 18, 2018Updated 8 years ago
- A set of utilities to handle Redis .rdb files with Ruby.☆36Apr 5, 2018Updated 8 years ago
- dashboard/alert/monitor for the numbat-powered metrics system☆25May 5, 2017Updated 9 years ago
- django-counter-field makes it extremely easy to denormalize and keep track of related model counts.☆18Dec 24, 2025Updated 8 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A very simple proxy handler for gin-gonic☆12Feb 3, 2016Updated 10 years ago
- Generate Redshift schemas from sample objects☆21Apr 25, 2014Updated 12 years ago
- A library of test.check generators for graph data☆10Apr 22, 2026Updated 4 months ago
- JRuby plugin for flume (jRubySource, jRubySink, jRubyDecorator).☆17Mar 18, 2011Updated 15 years ago
- Scripts for running Spark in CoreOS☆15Jul 22, 2014Updated 12 years ago
- Concurrent inverse Bloom filter.☆15Feb 3, 2015Updated 11 years ago
- Spec file, init scripts, and other stuff to build a kafka RPM.☆35Oct 14, 2016Updated 9 years ago
- Load testing for event analytics platforms (Snowplow, more coming soon)☆13May 17, 2016Updated 10 years ago
- MongoDB ORM for Node.js☆35Aug 23, 2012Updated 14 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- web pipes for your browser's omnibar!☆12Sep 22, 2011Updated 14 years ago
- A C++ wrapper around the OpenSSL cryptographic library.☆39Sep 29, 2011Updated 14 years ago
- Datomic Peer Buildpack & Service☆13Jan 5, 2016Updated 10 years ago
- counters and logarithmically bucketed histograms for distributed systems☆85Sep 3, 2017Updated 9 years ago
- Drop in sharing features for all iPhone and iPad apps☆11Nov 6, 2012Updated 13 years ago
- ☆10Nov 3, 2016Updated 9 years ago
- Store batched Kafka messages in S3.☆39Apr 13, 2022Updated 4 years ago