Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.
☆15Sep 6, 2013Updated 12 years ago
Alternatives and similar repositories for kafka-s3-consumer
Users that are interested in kafka-s3-consumer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An executable that polls S3 for added files, and runs a COPY command in Amazon Redshift for the new file.☆17May 24, 2013Updated 13 years ago
- Liquibase support for Redshift☆17Updated this week
- Utility to tail a file and push each new line into a kafka topic☆17Jun 19, 2014Updated 12 years ago
- Static Python Zookeeper Binding☆15Apr 25, 2023Updated 3 years ago
- An inspection and administration interface for Go programs, especially Go programs which run on GoCircuit.☆33Apr 27, 2015Updated 11 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Files to help make new spark EMR Bootstraps☆15Aug 4, 2013Updated 12 years ago
- Opinionated NSQ producer and consumer interfaces for Go☆19Mar 14, 2016Updated 10 years ago
- Tail a log file and send log lines automatically to a kafka topic☆19Jun 8, 2015Updated 11 years ago
- Pure and light binary records☆23May 20, 2014Updated 12 years ago
- go library for transparently writing to and reading from different types of paths (supports stdout, s3, and fs)☆14Nov 5, 2025Updated 8 months ago
- rootless chroot jails inside dynos☆30Dec 24, 2013Updated 12 years ago
- In-memory grouping, summarization, pivoting, cross-tabulation etc. of datasets☆15Apr 30, 2012Updated 14 years ago
- Optional Extension for Barman, Backup and Recovery Manager for PostgreSQL☆27Jul 21, 2016Updated 10 years ago
- Non-blocking Goliath webservice to convert images to ascii☆34Sep 18, 2011Updated 14 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple spdy server I wrote.☆15Oct 6, 2013Updated 12 years ago
- Ansi C Redis .rdb dump file analyzer☆24Oct 8, 2012Updated 13 years ago
- Ruby bindings for librrd. Extracted from the RRDtool source.☆18Oct 19, 2013Updated 12 years ago
- Go wrapper around os.Getenv() that returns an error instead of empty string☆21May 18, 2015Updated 11 years ago
- Rack middleware to track throughput and response time with metriks☆26Jun 14, 2013Updated 13 years ago
- levigo is a Go wrapper for LevelDB☆19Jan 30, 2014Updated 12 years ago
- They only live to get radical.☆13Nov 29, 2018Updated 7 years ago
- See Twitter's emotional state, in real-time☆29Feb 4, 2010Updated 16 years ago
- A set of utilities to handle Redis .rdb files with Ruby.☆36Apr 5, 2018Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A very simple proxy handler for gin-gonic☆12Feb 3, 2016Updated 10 years ago
- Generate Redshift schemas from sample objects☆21Apr 25, 2014Updated 12 years ago
- A library of test.check generators for graph data☆10Apr 22, 2026Updated 3 months ago
- JRuby plugin for flume (jRubySource, jRubySink, jRubyDecorator).☆17Mar 18, 2011Updated 15 years ago
- Scripts for running Spark in CoreOS☆15Jul 22, 2014Updated 12 years ago
- Churros is a Javascript library for sycing a local HTML 5 Web SQL Database with your server's database.☆13Feb 27, 2011Updated 15 years ago
- `which` for open files☆15Jan 23, 2013Updated 13 years ago
- Public url for your local django web server☆19Jul 18, 2018Updated 8 years ago
- experimental PostgreSQL data type with encryption off-loaded to a trusted component☆18Nov 23, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Load testing for event analytics platforms (Snowplow, more coming soon)☆13May 17, 2016Updated 10 years ago
- Statsd middleware for reporting on requests.☆17Mar 17, 2015Updated 11 years ago
- Run go programs as a service on major platforms.☆16Aug 11, 2015Updated 10 years ago
- MongoDB ORM for Node.js☆35Aug 23, 2012Updated 13 years ago
- web pipes for your browser's omnibar!☆12Sep 22, 2011Updated 14 years ago
- Datomic Peer Buildpack & Service☆13Jan 5, 2016Updated 10 years ago
- counters and logarithmically bucketed histograms for distributed systems☆84Sep 3, 2017Updated 8 years ago