spark自学手册,包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake,以及scala基础练习,还有一些例如master、shuffle源码分析,总结及翻译。
☆18Jul 19, 2023Updated 2 years ago
Alternatives and similar repositories for wow-spark
Users that are interested in wow-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark stream from kafka(json) to s3(parquet)☆15Nov 8, 2018Updated 7 years ago
- spark高级数据分析☆20May 9, 2016Updated 9 years ago
- Delta Lake Examples☆11Apr 24, 2020Updated 5 years ago
- Spark Structured Streaming JDBC Sink☆16Apr 26, 2021Updated 4 years ago
- 一个基于Flink的数据流业务处理平台☆26Oct 9, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Big data smart alarm by sql☆12May 11, 2021Updated 4 years ago
- low-level helpers for Apache Spark libraries and tests☆16Dec 29, 2018Updated 7 years ago
- An easy-to-use, scalable spark streaming ETL tool and sdk☆13Aug 14, 2017Updated 8 years ago
- Simulation of job offers and CVs with real-time processing, classification, and analytics using Kafka, Ray, Spark, and Databricks. Includ…☆14Dec 25, 2024Updated last year
- Helpers for dealing with python.subprocess.Popen and paramiko.☆18Mar 16, 2026Updated last month
- 1.Spark离线批处理,用户实时点击统计;2.SparkSQL日志内容分析;3.受众电影分析 =>(Kafka + SparkStreaming + Redis)和(Kafka + SparkStreaming + Mysql)☆29Jun 21, 2022Updated 3 years ago
- A repo containing code for a modern Docker + Jenkins CI / CD System☆15Aug 17, 2019Updated 6 years ago
- ☆20Apr 27, 2012Updated 13 years ago
- Execute SQL on top of JSON☆17Oct 4, 2017Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A library based on delta for Spark and MLSQL☆60Dec 24, 2020Updated 5 years ago
- CDH6.3.2离线安装☆11Nov 2, 2020Updated 5 years ago
- 使用Spark GraphX基于PageRank算法构建一个仿微博用户好友的分布式推荐系统。☆24Aug 26, 2018Updated 7 years ago
- ☆12Mar 15, 2022Updated 4 years ago
- Leveraging Hortonworks' HDP 3.1.0 and HDF 3.4.0 components, this tutorial guides the user through steps to stream data from a REST API in…☆19Aug 16, 2019Updated 6 years ago
- 基于SparkML2.0进行的Kaggle、JData等比赛☆42Dec 14, 2022Updated 3 years ago
- ☆15Jan 17, 2022Updated 4 years ago
- DataQuality for BigData☆148Dec 15, 2023Updated 2 years ago
- Workshop for Spark and Databricks☆55Dec 6, 2019Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 使用Spark Graphx 分析金庸”射雕三部曲“☆46Nov 5, 2020Updated 5 years ago
- Data Quality Monitoring Tool☆15Dec 5, 2017Updated 8 years ago
- Apache Flink 学习的Demo☆10Jun 21, 2017Updated 8 years ago
- Apache Pulsar Adapters☆24Dec 20, 2024Updated last year
- MapReduce scripts written in Python for Hadoop Streaming☆10Jun 10, 2014Updated 11 years ago
- ☆17Jan 2, 2026Updated 3 months ago
- A curated list of awesome Databricks resources, including Spark☆22Jun 28, 2024Updated last year
- 一键建湖,增量入湖方案☆11Jun 17, 2022Updated 3 years ago
- QPS流量控制starter☆30May 8, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 一些机器学习的实践☆11Jun 29, 2022Updated 3 years ago
- ☆23Jun 29, 2022Updated 3 years ago
- 基于阿里云的DTS进行的二次开发,基于SpringBoot框架进行消息格式转化、集成客户端kakfa☆24May 21, 2021Updated 4 years ago
- 这是一个由LangGraph协议主导的因果分析Muti-Agent,结合MCP,RAG等多种工具进行辅助进行因果分析,提供给用户一份完善的因果分析的分析报告和因果图☆35Apr 6, 2026Updated last week
- Custom datasource about spark structure streaming☆12Jan 29, 2019Updated 7 years ago
- Materials for various Hadoop & Nifi related workshops☆52Mar 20, 2019Updated 7 years ago
- Create a data mart using Azure Data Factory as ELT / ETL, Azure Synapse as database and Power BI as visualization tool.☆20Apr 20, 2022Updated 3 years ago