A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml
☆20Feb 3, 2026Updated last month
Alternatives and similar repositories for spark-etl-framework
Users that are interested in spark-etl-framework are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Feb 10, 2017Updated 9 years ago
- Jobcenter, a client-server application and framework for job management and distributed job execution☆11Aug 19, 2019Updated 6 years ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆48Dec 14, 2025Updated 3 months ago
- Redis connection that serializes all values using json, pickle, msgpack or a custom serializer.☆12Mar 12, 2021Updated 5 years ago
- Set of extensions for kafka connect hdfs☆11May 12, 2021Updated 4 years ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- Genetic algorithm applied to the Magic Square problem☆19Dec 23, 2019Updated 6 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Nov 29, 2016Updated 9 years ago
- Artifacts of the EKGF Data Product Workgroup (DPROD)☆36Mar 12, 2026Updated 2 weeks ago
- Efficiency of hbase concurrent writing, hbase synchronization to elasticsearch and elasticsearch concurrent querying.☆13Nov 15, 2018Updated 7 years ago
- [译] 面向机器学习的特征工程☆11Aug 9, 2018Updated 7 years ago
- AnyListen Music Player (Fork From https://github.com/Alkalinee/Hurricane)☆14Nov 3, 2016Updated 9 years ago
- The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage o…☆31Jun 18, 2025Updated 9 months ago
- ☆38May 22, 2024Updated last year
- bash scripts install docker☆11May 21, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Self-hostable headless QR code generator☆18Feb 5, 2026Updated last month
- DataCastle 大学生助学金精准资助预测（样本不均衡条件下的多分类任务）第7/352名解决方案☆12Feb 24, 2017Updated 9 years ago
- ☆20Dec 21, 2016Updated 9 years ago
- Manage one or more PubSub instances using the Elixir registry☆20May 1, 2023Updated 2 years ago
- Daily habit tracker and counter☆11Apr 2, 2024Updated last year
- Proof-of-concept distributed key-value store implementation on top of MicroRaft, Protocol Buffers, and gRPC☆14Feb 15, 2023Updated 3 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆95May 9, 2025Updated 10 months ago
- A flexible port forwarder among TCP, UNIX socket and (optionally) Tailscale, with PROXY protocol support, written in Golang.☆14Sep 24, 2024Updated last year
- Tool for turning Elixir apps into Docker images without a pain.☆18Jan 15, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆26Dec 18, 2019Updated 6 years ago
- Scripts and utilities to install and manage KVM machines☆11Jan 25, 2023Updated 3 years ago
- 基于spring boot 3.x的starter组件，集成了钉钉机器人发送消息通知，支持多机器人☆12Feb 13, 2023Updated 3 years ago
- Flink jobs collection☆17Oct 13, 2020Updated 5 years ago
- A Lasp PG adapter for the Phoenix framework pubsub☆18Apr 18, 2018Updated 7 years ago
- ☆14May 23, 2017Updated 8 years ago
- Caddy Web UI is a user-friendly interface for managing Caddy server configurations. The application allows users to create, edit, and del…☆16Feb 12, 2026Updated last month
- A candid data lake service for the internet computer.☆15Jun 30, 2021Updated 4 years ago
- An excel-like spreadsheet component for SQLPage☆16Aug 4, 2025Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Go 语言编程的一些代码示例，开箱即用。☆13Nov 5, 2023Updated 2 years ago
- 大型电商网站session 大数据分析实战项目☆19Jun 21, 2022Updated 3 years ago
- Manage your dotfiles, upload and install☆14Nov 13, 2024Updated last year
- A reverse proxy manager written in go, to convert exposed ports into token-based auth protected ports☆20Apr 14, 2025Updated 11 months ago
- Unofficial Facebook Messenger Platform *chatbot client* and *webhook handler*☆16Aug 2, 2021Updated 4 years ago
- Elm SPA for live station schedules for Helsinki region commuter trains☆25Nov 21, 2024Updated last year
- Utility project for working with Kafka Connect.☆34Jul 31, 2024Updated last year