Life-cycle: Internal working of HDFS, SQOOP, HIVE, SPARK, HBASE, KAFKA with code.
☆15Sep 10, 2019Updated 6 years ago
Alternatives and similar repositories for BigData-Ecosystem-Architecture
Users that are interested in BigData-Ecosystem-Architecture are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project deals with vulnerability analysis and classification using machine learning techniques i.e. Natural Language Processing.☆10Feb 21, 2019Updated 7 years ago
- How to construct, test, build and deploy a custom Nifi Processor☆13Mar 28, 2017Updated 9 years ago
- Livy Manager - Web UI for Managing Apache Livy Sessions☆16Dec 7, 2017Updated 8 years ago
- A curated list of data engineering tools for software developers☆13Jan 8, 2019Updated 7 years ago
- k8s hadoop,在k8s上快速搭建一个hadoop/hbase/hive环境，很早的项目自已用，腾讯tbds培训，以此为基础(多了一个kafka/flink)搭一套环境练习，又捡起来了☆21Mar 21, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆12Feb 19, 2020Updated 6 years ago
- Apache Spark with HDFS cluster within Kubernetes☆12Jul 11, 2023Updated 3 years ago
- ☆13Jan 16, 2020Updated 6 years ago
- DOP是一个基于蓝鲸智云开发的数据管理工具，旨在简化各类大数据组件的日常运维操作、降低使用门槛、提高运维效率，目前支持Elasticsearch、Kafka、Hadoop。☆15Feb 28, 2023Updated 3 years ago
- This reference architecture demonstrates the use of AWS Step Functions to orchestrate an Extract Transfer Load (ETL) workflow with AWS La…☆24Jun 16, 2020Updated 6 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆12Jul 16, 2019Updated 7 years ago
- 基于Kubernetes v1.22.2集群部署ELK日志分析系统。并收集与展示Nginx的access访问日志。☆11Jan 26, 2022Updated 4 years ago
- Predicting air pollution (machine learning project)☆21Feb 19, 2017Updated 9 years ago
- ☆10Jan 27, 2016Updated 10 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- My solutions for the Udacity Data Engineering Nanodegree☆34Oct 14, 2019Updated 6 years ago
- Learn Python! Python is a programming language that lets you work quickly and integrate systems more effectively.☆27Oct 1, 2023Updated 2 years ago
- My End-of-Degree thesis. Visual SLAM, DL, 3D sparse and dense maps and Computer Vision.☆15Jun 29, 2020Updated 6 years ago
- 在这个仓库里，我会放一些与我博客相关的强化学习相关的代码。☆13Oct 23, 2020Updated 5 years ago
- This sample project shows off how to prepare and deploy to Azure Web Apps a simple Python web service with an image classifying model pro…☆27Feb 5, 2018Updated 8 years ago
- Udacity Data Engineering Nanodegree Capstone Project☆36May 9, 2020Updated 6 years ago
- Random code snippets used to learn x86_64 assembly language☆33Oct 2, 2019Updated 6 years ago
- Reads a HBase table and writes the out as Text, Seq, Avro, or Parquet☆28May 15, 2014Updated 12 years ago
- Deploy a simple Multi-Node Clickhouse Cluster with docker-compose in minutes.☆17Feb 11, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🚀 Material-UI based Audio Player☆10Dec 2, 2022Updated 3 years ago
- ☆15Jan 28, 2025Updated last year
- 大数据自动化部署，包括自动化部署hadoop、hive、hbase、spark、storm等等一系列组件☆71Jul 30, 2018Updated 8 years ago
- WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging …☆31Jun 23, 2026Updated last month
- a brief guide on building a secure instant messaging app for Android☆28Jan 23, 2020Updated 6 years ago
- JUnit integration for testing the Apache Hive Metastore and HiveServer2 Thrift APIs☆26Jul 22, 2025Updated last year
- Scripts for installing Hadoop, HBase, Hive, Pig & Spark.☆10Nov 13, 2019Updated 6 years ago
- ☆14Jun 16, 2016Updated 10 years ago
- quick start guide☆18Jul 22, 2019Updated 7 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- hadoop中Map/Reduce使用示例，输入(DBInputFormat),输出(DBOutputFormat)为MySql数据库表、日志分析Grep、单词排序Sort...对HBase的基本操作，增、删、查、改，使用Map/Reduce批量导入数据到HBase表中..…☆14Apr 6, 2013Updated 13 years ago
- Reference Architectures for Apache Spark☆38Jan 23, 2017Updated 9 years ago
- A ROS-based introspection tool for visualizing the structure and state of SMACH plans.☆20Sep 29, 2025Updated 10 months ago
- A dockerized small bigdata cluster to play with☆13Jun 14, 2016Updated 10 years ago
- ☆12May 11, 2016Updated 10 years ago
- Obstacle avoidance for drone with cable suspended payload using RGBD Camera, Octomap and PX4 Firmware☆21Sep 16, 2022Updated 3 years ago
- A set of commands for managing CDH clusters using Cloudera Manager REST API.☆34Jun 27, 2023Updated 3 years ago