✨ A Pydantic to PySpark schema library
☆123Apr 8, 2026Updated this week
Alternatives and similar repositories for sparkdantic
Users that are interested in sparkdantic are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Manage Unity Catalog tables with Pydantic Models☆10Mar 5, 2025Updated last year
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆227Mar 30, 2026Updated 2 weeks ago
- Delta Lake helper methods in PySpark☆328Jan 19, 2026Updated 2 months ago
- PySpark schema generator☆44Feb 23, 2023Updated 3 years ago
- Map your python dataclasses to pyspark types☆10Feb 11, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code examples for the Introduction to Kubeflow course☆15Jan 12, 2021Updated 5 years ago
- PySpark test helper methods with beautiful error messages☆759Updated this week
- Apache Spark Connect Client for Rust☆117Jun 10, 2025Updated 10 months ago
- Incan: a modern, Pythonic language that compiles to Rust! Type-safe, async-friendly, with fixtures, testing, and web/inter-op built in.☆16Apr 7, 2026Updated last week
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆28Jun 20, 2025Updated 9 months ago
- OCaml and Rust-style exhaustive exception handling for Python.☆34Jan 2, 2026Updated 3 months ago
- A simplified, autogenerated API client interface using the databricks-cli package☆59Jun 8, 2023Updated 2 years ago
- Column-wise type annotations for pyspark DataFrames☆99Updated this week
- SQLAlchemy dialect for Databricks☆20May 15, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Notebooks to learn Databricks Lakehouse Platform☆42Apr 7, 2026Updated last week
- The official repository for the Rock the JVM Spark Streaming course☆19Oct 16, 2023Updated 2 years ago
- ☆26Mar 4, 2024Updated 2 years ago
- ☆11Dec 23, 2017Updated 8 years ago
- Desafio 5DataGlowUp☆25Oct 20, 2023Updated 2 years ago
- A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs☆46May 10, 2024Updated last year
- ☆23Nov 17, 2022Updated 3 years ago
- A Python Library to support running data quality rules while the spark job is running⚡☆201Updated this week
- ☆23May 2, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Spin up a minimalistic Data Analytics Platform on a European cloud provider☆19Sep 9, 2025Updated 7 months ago
- A rust implemention based on `How Query Engines Work`☆14Sep 2, 2024Updated last year
- Quickner is a new tool to quickly annotate texts for NER (Named Entity Recognition). It is written in Rust and accessible through a Pytho…☆21Feb 24, 2024Updated 2 years ago
- ☆20Sep 11, 2021Updated 4 years ago
- Collection of AWS Lambdas for creating and managing Delta tables☆57Apr 7, 2026Updated last week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆1,282Updated this week
- Open, Multi-modal Catalog for Data & AI☆3,354Updated this week
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆76Apr 24, 2024Updated last year
- Grafana plugin to display air conditions on a psychrometric chart.☆14Mar 23, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Write Web API clients using annotations in python☆16Updated this week
- Репозиторий курса "Modern Storages and Data Warehousing", ПИ, НИУ ВШЭ, 2024☆14Apr 13, 2025Updated last year
- Spotify.js is Universal wrapper for Spotify web API☆21Nov 29, 2020Updated 5 years ago
- Simple Syntax-Directed Interpreter for a subset of SQL☆13Jan 3, 2011Updated 15 years ago
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,247Updated this week
- Run pgbadger report on RDS instances☆13May 17, 2021Updated 4 years ago
- Unity Catalog UI☆43Sep 6, 2024Updated last year