dvryaboy / idl_storage_guidelinesLinks
This document attempts to capture useful patterns and warn about subtle gotchas when it comes to designing and evolving schemas for long-term serialized data. It is not intended as a guide for how to best represent a particular dataset or process.
☆13Updated 8 years ago
Alternatives and similar repositories for idl_storage_guidelines
Users that are interested in idl_storage_guidelines are comparing it to the libraries listed below
Sorting:
- HDFS compatible Distributed Filesystem backed Cassandra☆25Updated 9 years ago
- Simple Samza Job Using Confluent Platform☆14Updated 9 years ago
- A Kafka-Connect Sink for S3 with no Hadoop dependencies.☆57Updated 2 years ago
- An application that records stats about consumer group offset commits and reports them as prometheus metrics☆14Updated 6 years ago
- Experimental mechanism for forwarding data regardless of B3 sampling☆10Updated last year
- Paper: A Zero-rename committer for object stores☆20Updated 4 years ago
- A small project to report offset lag for Kafka Consumer Groups via Burrow.☆32Updated 5 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 6 years ago
- Cascading on Apache Flink®☆54Updated last year
- Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…☆13Updated 8 years ago
- ☆21Updated 2 years ago
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 9 years ago
- Playbook to provision a Confluent Cluster☆10Updated 7 years ago
- Cassandra Node Diagnostics Tools☆51Updated 7 years ago
- No longer maintained. Use https://eventsizer.io instead.☆62Updated 6 years ago
- ☆26Updated 5 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated last month
- Mirus is a cross data-center data replication tool for Apache Kafka☆204Updated 2 months ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago
- Graph Analytics with Apache Kafka☆104Updated this week
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Updated 9 years ago
- Web UI for Cassandra Reaper☆22Updated 8 years ago
- Automated rack-aware assignment of Kafka partitions to brokers☆61Updated 4 years ago
- Images and links to references for Kafka Fault Tree Analysis talks by Andrey Falko☆21Updated 3 years ago
- Use SQL to transform your avro schema/records☆28Updated 7 years ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆111Updated 5 years ago
- Examples of user defined functions for Apache Drill☆18Updated 8 years ago
- A template-based cluster provisioning system☆61Updated 2 years ago
- Zipkin Mesos Framework☆31Updated 9 years ago