FINRAOS / herdLinks
Herd is a managed data lake for the cloud. The Herd unified data catalog helps separate storage from compute in the cloud. Manage petabytes of data and make it accessible for data processing and analytical purposes by any cloud compute platform.
☆135Updated 2 years ago
Alternatives and similar repositories for herd
Users that are interested in herd are comparing it to the libraries listed below
Sorting:
- Apache Spark on AWS Lambda☆153Updated 2 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆75Updated 6 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 6 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆47Updated last year
- kinesis-kafka-connector is connector based on Kafka Connect to publish messages to Amazon Kinesis streams or Amazon Kinesis Firehose.☆155Updated last year
- Implementations of open source Apache Hadoop/Hive interfaces which allow for ingesting data from Amazon DynamoDB☆226Updated last month
- Demonstrates NiFi template deployment and configuration via a REST API☆70Updated 8 years ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year
- Cloudera Director sample code☆61Updated 5 years ago
- A visual ETL development and debugging tool for big data☆153Updated 2 years ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆222Updated 3 months ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆51Updated last week
- Reference Architectures for Datalakes on AWS☆79Updated 5 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆62Updated 2 years ago
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆117Updated 2 years ago
- Vagrant files creating multi-node virtual Hadoop clusters with or without security.☆67Updated 5 years ago
- Core OJAI APIs☆47Updated last year
- Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.☆150Updated 4 years ago
- An opinionated auto-deployer for the Hortonworks Platform☆34Updated 4 years ago
- DataPipeline for humans.☆249Updated 2 years ago
- Bender - Serverless ETL Framework☆185Updated last year
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- An open-source, vendor-neutral data context service.☆159Updated 7 years ago
- Redshift Ops Console☆92Updated 9 years ago
- Cloudbreak Deployer Tool☆34Updated last year
- Reference architecture for real-time stream processing with Apache Flink on Amazon EMR, Amazon Kinesis, and Amazon Elasticsearch Service.☆72Updated last year
- Create Parquet files from CSV☆68Updated 7 years ago
- ☆326Updated 4 years ago